A Survey of Evolutionary Algorithms for Supervised Ensemble Learning
Autor(a) principal: | |
---|---|
Data de Publicação: | 2023 |
Outros Autores: | , , |
Tipo de documento: | Artigo de conferência |
Idioma: | eng |
Título da fonte: | Manancial - Repositório Digital da UFSM |
Texto Completo: | http://repositorio.ufsm.br/handle/1/30244 |
Resumo: | This paper presents a comprehensive review of evolutionary algorithms that learn an ensemble of predictive models for supervised machine learning (classification and regression). We propose a detailed four-level taxonomy of studies in this area. The first level of the taxonomy categorizes studies based on which stage of the ensemble learning process is addressed by the evolutionary algorithm: the generation of base models, model selection, or the integration of outputs. The next three levels of the taxonomy further categorize studies based on methods used to address each stage. In addition, we categorize studies according to the main types of objectives optimized by the evolutionary algorithm, the type of base learner used and the type of evolutionary algorithm used. We also discuss controversial topics, like the pros and cons of the selection stage of ensemble learning, and the need for using a diversity measure for the ensemble’s members in the fitness function. Finally, as conclusions, we summarize our findings about patterns in the frequency of use of different methods, and suggest several new research directions for evolutionary ensemble learning. |
id |
UFSM-20_1a4f2bac9a7a6ae2f4e7f47bf33fd4d8 |
---|---|
oai_identifier_str |
oai:repositorio.ufsm.br:1/30244 |
network_acronym_str |
UFSM-20 |
network_name_str |
Manancial - Repositório Digital da UFSM |
repository_id_str |
3913 |
spelling |
2023-09-19T18:12:33Z2023-09-19T18:12:33Z2023http://repositorio.ufsm.br/handle/1/30244engThe Knowledge Engineering Review10030030020260086cbc9b0-021b-4f35-a831-8ddf7e6d1d8d4147154f-b965-4bb4-a8b1-79f703d775fba60902b1-f190-4195-8bea-e9cc9da2928868042187-8de3-4843-b08c-c1e6934c7b0bAttribution-NonCommercial-NoDerivatives 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessA Survey of Evolutionary Algorithms for Supervised Ensemble LearningA Survey of Evolutionary Algorithms for Supervised Ensemble Learninginfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObjectThis paper presents a comprehensive review of evolutionary algorithms that learn an ensemble of predictive models for supervised machine learning (classification and regression). We propose a detailed four-level taxonomy of studies in this area. The first level of the taxonomy categorizes studies based on which stage of the ensemble learning process is addressed by the evolutionary algorithm: the generation of base models, model selection, or the integration of outputs. The next three levels of the taxonomy further categorize studies based on methods used to address each stage. In addition, we categorize studies according to the main types of objectives optimized by the evolutionary algorithm, the type of base learner used and the type of evolutionary algorithm used. We also discuss controversial topics, like the pros and cons of the selection stage of ensemble learning, and the need for using a diversity measure for the ensemble’s members in the fitness function. Finally, as conclusions, we summarize our findings about patterns in the frequency of use of different methods, and suggest several new research directions for evolutionary ensemble learning.CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWARECagnini, Henry E.L.Dˆores, Silvia C.N. dasFreitas, Alex A.Barros, Rodrigo C.Brasilreponame:Manancial - Repositório Digital da UFSMinstname:Universidade Federal de Santa Maria (UFSM)instacron:UFSMLICENSElicense.txtlicense.txttext/plain; charset=utf-81956http://repositorio.ufsm.br/bitstream/1/30244/3/license.txt2f0571ecee68693bd5cd3f17c1e075dfMD53CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8805http://repositorio.ufsm.br/bitstream/1/30244/2/license_rdf4460e5956bc1d1639be9ae6146a50347MD52ORIGINAL_KER__survey_of_EA_for_EL.pdf_KER__survey_of_EA_for_EL.pdfArtigoapplication/pdf578828http://repositorio.ufsm.br/bitstream/1/30244/1/_KER__survey_of_EA_for_EL.pdf3573f56a8eaea6bed1a73d2c6afafb34MD511/302442023-09-19 15:12:33.598oai:repositorio.ufsm.br:1/30244TElDRU7Dh0EgREUgRElTVFJJQlVJw4fDg08gTsODTy1FWENMVVNJVkEKCkNvbSBhIGFwcmVzZW50YcOnw6NvIGRlc3RhIGxpY2Vuw6dhLCB2b2PDqiAobyBhdXRvciAoZXMpIG91IG8gdGl0dWxhciBkb3MgZGlyZWl0b3MgZGUgYXV0b3IpIGNvbmNlZGUgw6AgVW5pdmVyc2lkYWRlCkZlZGVyYWwgZGUgU2FudGEgTWFyaWEgKFVGU00pIG8gZGlyZWl0byBuw6NvLWV4Y2x1c2l2byBkZSByZXByb2R1emlyLCAgdHJhZHV6aXIgKGNvbmZvcm1lIGRlZmluaWRvIGFiYWl4byksIGUvb3UKZGlzdHJpYnVpciBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gKGluY2x1aW5kbyBvIHJlc3VtbykgcG9yIHRvZG8gbyBtdW5kbyBubyBmb3JtYXRvIGltcHJlc3NvIGUgZWxldHLDtG5pY28gZQplbSBxdWFscXVlciBtZWlvLCBpbmNsdWluZG8gb3MgZm9ybWF0b3Mgw6F1ZGlvIG91IHbDrWRlby4KClZvY8OqIGNvbmNvcmRhIHF1ZSBhIFVGU00gcG9kZSwgc2VtIGFsdGVyYXIgbyBjb250ZcO6ZG8sIHRyYW5zcG9yIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbwpwYXJhIHF1YWxxdWVyIG1laW8gb3UgZm9ybWF0byBwYXJhIGZpbnMgZGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIHRhbWLDqW0gY29uY29yZGEgcXVlIGEgVUZTTSBwb2RlIG1hbnRlciBtYWlzIGRlIHVtYSBjw7NwaWEgYSBzdWEgdGVzZSBvdQpkaXNzZXJ0YcOnw6NvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIGRlY2xhcmEgcXVlIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyDDqSBvcmlnaW5hbCBlIHF1ZSB2b2PDqiB0ZW0gbyBwb2RlciBkZSBjb25jZWRlciBvcyBkaXJlaXRvcyBjb250aWRvcwpuZXN0YSBsaWNlbsOnYS4gVm9jw6ogdGFtYsOpbSBkZWNsYXJhIHF1ZSBvIGRlcMOzc2l0byBkYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIG7Do28sIHF1ZSBzZWphIGRlIHNldQpjb25oZWNpbWVudG8sIGluZnJpbmdlIGRpcmVpdG9zIGF1dG9yYWlzIGRlIG5pbmd1w6ltLgoKQ2FzbyBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gY29udGVuaGEgbWF0ZXJpYWwgcXVlIHZvY8OqIG7Do28gcG9zc3VpIGEgdGl0dWxhcmlkYWRlIGRvcyBkaXJlaXRvcyBhdXRvcmFpcywgdm9jw6oKZGVjbGFyYSBxdWUgb2J0ZXZlIGEgcGVybWlzc8OjbyBpcnJlc3RyaXRhIGRvIGRldGVudG9yIGRvcyBkaXJlaXRvcyBhdXRvcmFpcyBwYXJhIGNvbmNlZGVyIMOgIFVGU00Kb3MgZGlyZWl0b3MgYXByZXNlbnRhZG9zIG5lc3RhIGxpY2Vuw6dhLCBlIHF1ZSBlc3NlIG1hdGVyaWFsIGRlIHByb3ByaWVkYWRlIGRlIHRlcmNlaXJvcyBlc3TDoSBjbGFyYW1lbnRlCmlkZW50aWZpY2FkbyBlIHJlY29uaGVjaWRvIG5vIHRleHRvIG91IG5vIGNvbnRlw7pkbyBkYSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gb3JhIGRlcG9zaXRhZGEuCgpDQVNPIEEgVEVTRSBPVSBESVNTRVJUQcOHw4NPIE9SQSBERVBPU0lUQURBIFRFTkhBIFNJRE8gUkVTVUxUQURPIERFIFVNIFBBVFJPQ8ONTklPIE9VCkFQT0lPIERFIFVNQSBBR8OKTkNJQSBERSBGT01FTlRPIE9VIE9VVFJPIE9SR0FOSVNNTyBRVUUgTsODTyBTRUpBIEEgVUZTTQosIFZPQ8OKIERFQ0xBUkEgUVVFIFJFU1BFSVRPVSBUT0RPUyBFIFFVQUlTUVVFUiBESVJFSVRPUyBERSBSRVZJU8ODTyBDT01PClRBTULDiU0gQVMgREVNQUlTIE9CUklHQcOHw5VFUyBFWElHSURBUyBQT1IgQ09OVFJBVE8gT1UgQUNPUkRPLgoKQSBVRlNNIHNlIGNvbXByb21ldGUgYSBpZGVudGlmaWNhciBjbGFyYW1lbnRlIG8gc2V1IG5vbWUgKHMpIG91IG8ocykgbm9tZShzKSBkbyhzKQpkZXRlbnRvcihlcykgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIGRhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbywgZSBuw6NvIGZhcsOhIHF1YWxxdWVyIGFsdGVyYcOnw6NvLCBhbMOpbSBkYXF1ZWxhcwpjb25jZWRpZGFzIHBvciBlc3RhIGxpY2Vuw6dhLgoKRepositório Institucionalhttp://repositorio.ufsm.br/PUBhttp://repositorio.ufsm.br/oai/requestopendoar:39132023-09-19T18:12:33Manancial - Repositório Digital da UFSM - Universidade Federal de Santa Maria (UFSM)false |
dc.title.por.fl_str_mv |
A Survey of Evolutionary Algorithms for Supervised Ensemble Learning |
dc.title.alternative.eng.fl_str_mv |
A Survey of Evolutionary Algorithms for Supervised Ensemble Learning |
title |
A Survey of Evolutionary Algorithms for Supervised Ensemble Learning |
spellingShingle |
A Survey of Evolutionary Algorithms for Supervised Ensemble Learning Cagnini, Henry E.L. CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWARE |
title_short |
A Survey of Evolutionary Algorithms for Supervised Ensemble Learning |
title_full |
A Survey of Evolutionary Algorithms for Supervised Ensemble Learning |
title_fullStr |
A Survey of Evolutionary Algorithms for Supervised Ensemble Learning |
title_full_unstemmed |
A Survey of Evolutionary Algorithms for Supervised Ensemble Learning |
title_sort |
A Survey of Evolutionary Algorithms for Supervised Ensemble Learning |
author |
Cagnini, Henry E.L. |
author_facet |
Cagnini, Henry E.L. Dˆores, Silvia C.N. das Freitas, Alex A. Barros, Rodrigo C. |
author_role |
author |
author2 |
Dˆores, Silvia C.N. das Freitas, Alex A. Barros, Rodrigo C. |
author2_role |
author author author |
dc.contributor.author.fl_str_mv |
Cagnini, Henry E.L. Dˆores, Silvia C.N. das Freitas, Alex A. Barros, Rodrigo C. |
dc.subject.cnpq.fl_str_mv |
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWARE |
topic |
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWARE |
description |
This paper presents a comprehensive review of evolutionary algorithms that learn an ensemble of predictive models for supervised machine learning (classification and regression). We propose a detailed four-level taxonomy of studies in this area. The first level of the taxonomy categorizes studies based on which stage of the ensemble learning process is addressed by the evolutionary algorithm: the generation of base models, model selection, or the integration of outputs. The next three levels of the taxonomy further categorize studies based on methods used to address each stage. In addition, we categorize studies according to the main types of objectives optimized by the evolutionary algorithm, the type of base learner used and the type of evolutionary algorithm used. We also discuss controversial topics, like the pros and cons of the selection stage of ensemble learning, and the need for using a diversity measure for the ensemble’s members in the fitness function. Finally, as conclusions, we summarize our findings about patterns in the frequency of use of different methods, and suggest several new research directions for evolutionary ensemble learning. |
publishDate |
2023 |
dc.date.submitted.none.fl_str_mv |
2023 |
dc.date.accessioned.fl_str_mv |
2023-09-19T18:12:33Z |
dc.date.available.fl_str_mv |
2023-09-19T18:12:33Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/conferenceObject |
format |
conferenceObject |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://repositorio.ufsm.br/handle/1/30244 |
url |
http://repositorio.ufsm.br/handle/1/30244 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.cnpq.fl_str_mv |
100300300202 |
dc.relation.confidence.fl_str_mv |
600 |
dc.relation.authority.fl_str_mv |
86cbc9b0-021b-4f35-a831-8ddf7e6d1d8d 4147154f-b965-4bb4-a8b1-79f703d775fb a60902b1-f190-4195-8bea-e9cc9da29288 68042187-8de3-4843-b08c-c1e6934c7b0b |
dc.relation.ispartof.por.fl_str_mv |
The Knowledge Engineering Review |
dc.rights.driver.fl_str_mv |
Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ info:eu-repo/semantics/openAccess |
rights_invalid_str_mv |
Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ |
eu_rights_str_mv |
openAccess |
dc.publisher.country.fl_str_mv |
Brasil |
dc.source.none.fl_str_mv |
reponame:Manancial - Repositório Digital da UFSM instname:Universidade Federal de Santa Maria (UFSM) instacron:UFSM |
instname_str |
Universidade Federal de Santa Maria (UFSM) |
instacron_str |
UFSM |
institution |
UFSM |
reponame_str |
Manancial - Repositório Digital da UFSM |
collection |
Manancial - Repositório Digital da UFSM |
bitstream.url.fl_str_mv |
http://repositorio.ufsm.br/bitstream/1/30244/3/license.txt http://repositorio.ufsm.br/bitstream/1/30244/2/license_rdf http://repositorio.ufsm.br/bitstream/1/30244/1/_KER__survey_of_EA_for_EL.pdf |
bitstream.checksum.fl_str_mv |
2f0571ecee68693bd5cd3f17c1e075df 4460e5956bc1d1639be9ae6146a50347 3573f56a8eaea6bed1a73d2c6afafb34 |
bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 |
repository.name.fl_str_mv |
Manancial - Repositório Digital da UFSM - Universidade Federal de Santa Maria (UFSM) |
repository.mail.fl_str_mv |
|
_version_ |
1794523850103324672 |