A Survey of Evolutionary Algorithms for Supervised Ensemble Learning

Detalhes bibliográficos
Autor(a) principal: Cagnini, Henry E.L.
Data de Publicação: 2023
Outros Autores: Dˆores, Silvia C.N. das, Freitas, Alex A., Barros, Rodrigo C.
Tipo de documento: Artigo de conferência
Idioma: eng
Título da fonte: Biblioteca Digital de Teses e Dissertações do UFSM
Texto Completo: http://repositorio.ufsm.br/handle/1/30244
Resumo: This paper presents a comprehensive review of evolutionary algorithms that learn an ensemble of predictive models for supervised machine learning (classification and regression). We propose a detailed four-level taxonomy of studies in this area. The first level of the taxonomy categorizes studies based on which stage of the ensemble learning process is addressed by the evolutionary algorithm: the generation of base models, model selection, or the integration of outputs. The next three levels of the taxonomy further categorize studies based on methods used to address each stage. In addition, we categorize studies according to the main types of objectives optimized by the evolutionary algorithm, the type of base learner used and the type of evolutionary algorithm used. We also discuss controversial topics, like the pros and cons of the selection stage of ensemble learning, and the need for using a diversity measure for the ensemble’s members in the fitness function. Finally, as conclusions, we summarize our findings about patterns in the frequency of use of different methods, and suggest several new research directions for evolutionary ensemble learning.
id UFSM_1a4f2bac9a7a6ae2f4e7f47bf33fd4d8
oai_identifier_str oai:repositorio.ufsm.br:1/30244
network_acronym_str UFSM
network_name_str Biblioteca Digital de Teses e Dissertações do UFSM
repository_id_str
spelling 2023-09-19T18:12:33Z2023-09-19T18:12:33Z2023http://repositorio.ufsm.br/handle/1/30244engThe Knowledge Engineering Review10030030020260086cbc9b0-021b-4f35-a831-8ddf7e6d1d8d4147154f-b965-4bb4-a8b1-79f703d775fba60902b1-f190-4195-8bea-e9cc9da2928868042187-8de3-4843-b08c-c1e6934c7b0bAttribution-NonCommercial-NoDerivatives 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessA Survey of Evolutionary Algorithms for Supervised Ensemble LearningA Survey of Evolutionary Algorithms for Supervised Ensemble Learninginfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObjectThis paper presents a comprehensive review of evolutionary algorithms that learn an ensemble of predictive models for supervised machine learning (classification and regression). We propose a detailed four-level taxonomy of studies in this area. The first level of the taxonomy categorizes studies based on which stage of the ensemble learning process is addressed by the evolutionary algorithm: the generation of base models, model selection, or the integration of outputs. The next three levels of the taxonomy further categorize studies based on methods used to address each stage. In addition, we categorize studies according to the main types of objectives optimized by the evolutionary algorithm, the type of base learner used and the type of evolutionary algorithm used. We also discuss controversial topics, like the pros and cons of the selection stage of ensemble learning, and the need for using a diversity measure for the ensemble’s members in the fitness function. Finally, as conclusions, we summarize our findings about patterns in the frequency of use of different methods, and suggest several new research directions for evolutionary ensemble learning.CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWARECagnini, Henry E.L.Dˆores, Silvia C.N. dasFreitas, Alex A.Barros, Rodrigo C.Brasilreponame:Biblioteca Digital de Teses e Dissertações do UFSMinstname:Universidade Federal de Santa Maria (UFSM)instacron:UFSMLICENSElicense.txtlicense.txttext/plain; charset=utf-81956http://repositorio.ufsm.br/bitstream/1/30244/3/license.txt2f0571ecee68693bd5cd3f17c1e075dfMD53CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8805http://repositorio.ufsm.br/bitstream/1/30244/2/license_rdf4460e5956bc1d1639be9ae6146a50347MD52ORIGINAL_KER__survey_of_EA_for_EL.pdf_KER__survey_of_EA_for_EL.pdfArtigoapplication/pdf578828http://repositorio.ufsm.br/bitstream/1/30244/1/_KER__survey_of_EA_for_EL.pdf3573f56a8eaea6bed1a73d2c6afafb34MD511/302442023-09-19 15:12:33.598oai:repositorio.ufsm.br:1/30244TElDRU7Dh0EgREUgRElTVFJJQlVJw4fDg08gTsODTy1FWENMVVNJVkEKCkNvbSBhIGFwcmVzZW50YcOnw6NvIGRlc3RhIGxpY2Vuw6dhLCB2b2PDqiAobyBhdXRvciAoZXMpIG91IG8gdGl0dWxhciBkb3MgZGlyZWl0b3MgZGUgYXV0b3IpIGNvbmNlZGUgw6AgVW5pdmVyc2lkYWRlCkZlZGVyYWwgZGUgU2FudGEgTWFyaWEgKFVGU00pIG8gZGlyZWl0byBuw6NvLWV4Y2x1c2l2byBkZSByZXByb2R1emlyLCAgdHJhZHV6aXIgKGNvbmZvcm1lIGRlZmluaWRvIGFiYWl4byksIGUvb3UKZGlzdHJpYnVpciBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gKGluY2x1aW5kbyBvIHJlc3VtbykgcG9yIHRvZG8gbyBtdW5kbyBubyBmb3JtYXRvIGltcHJlc3NvIGUgZWxldHLDtG5pY28gZQplbSBxdWFscXVlciBtZWlvLCBpbmNsdWluZG8gb3MgZm9ybWF0b3Mgw6F1ZGlvIG91IHbDrWRlby4KClZvY8OqIGNvbmNvcmRhIHF1ZSBhIFVGU00gcG9kZSwgc2VtIGFsdGVyYXIgbyBjb250ZcO6ZG8sIHRyYW5zcG9yIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbwpwYXJhIHF1YWxxdWVyIG1laW8gb3UgZm9ybWF0byBwYXJhIGZpbnMgZGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIHRhbWLDqW0gY29uY29yZGEgcXVlIGEgVUZTTSBwb2RlIG1hbnRlciBtYWlzIGRlIHVtYSBjw7NwaWEgYSBzdWEgdGVzZSBvdQpkaXNzZXJ0YcOnw6NvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIGRlY2xhcmEgcXVlIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyDDqSBvcmlnaW5hbCBlIHF1ZSB2b2PDqiB0ZW0gbyBwb2RlciBkZSBjb25jZWRlciBvcyBkaXJlaXRvcyBjb250aWRvcwpuZXN0YSBsaWNlbsOnYS4gVm9jw6ogdGFtYsOpbSBkZWNsYXJhIHF1ZSBvIGRlcMOzc2l0byBkYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIG7Do28sIHF1ZSBzZWphIGRlIHNldQpjb25oZWNpbWVudG8sIGluZnJpbmdlIGRpcmVpdG9zIGF1dG9yYWlzIGRlIG5pbmd1w6ltLgoKQ2FzbyBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gY29udGVuaGEgbWF0ZXJpYWwgcXVlIHZvY8OqIG7Do28gcG9zc3VpIGEgdGl0dWxhcmlkYWRlIGRvcyBkaXJlaXRvcyBhdXRvcmFpcywgdm9jw6oKZGVjbGFyYSBxdWUgb2J0ZXZlIGEgcGVybWlzc8OjbyBpcnJlc3RyaXRhIGRvIGRldGVudG9yIGRvcyBkaXJlaXRvcyBhdXRvcmFpcyBwYXJhIGNvbmNlZGVyIMOgIFVGU00Kb3MgZGlyZWl0b3MgYXByZXNlbnRhZG9zIG5lc3RhIGxpY2Vuw6dhLCBlIHF1ZSBlc3NlIG1hdGVyaWFsIGRlIHByb3ByaWVkYWRlIGRlIHRlcmNlaXJvcyBlc3TDoSBjbGFyYW1lbnRlCmlkZW50aWZpY2FkbyBlIHJlY29uaGVjaWRvIG5vIHRleHRvIG91IG5vIGNvbnRlw7pkbyBkYSB0ZXNlIG91IGRpc3NlcnRhw6fDo28gb3JhIGRlcG9zaXRhZGEuCgpDQVNPIEEgVEVTRSBPVSBESVNTRVJUQcOHw4NPIE9SQSBERVBPU0lUQURBIFRFTkhBIFNJRE8gUkVTVUxUQURPIERFIFVNIFBBVFJPQ8ONTklPIE9VCkFQT0lPIERFIFVNQSBBR8OKTkNJQSBERSBGT01FTlRPIE9VIE9VVFJPIE9SR0FOSVNNTyBRVUUgTsODTyBTRUpBIEEgVUZTTQosIFZPQ8OKIERFQ0xBUkEgUVVFIFJFU1BFSVRPVSBUT0RPUyBFIFFVQUlTUVVFUiBESVJFSVRPUyBERSBSRVZJU8ODTyBDT01PClRBTULDiU0gQVMgREVNQUlTIE9CUklHQcOHw5VFUyBFWElHSURBUyBQT1IgQ09OVFJBVE8gT1UgQUNPUkRPLgoKQSBVRlNNIHNlIGNvbXByb21ldGUgYSBpZGVudGlmaWNhciBjbGFyYW1lbnRlIG8gc2V1IG5vbWUgKHMpIG91IG8ocykgbm9tZShzKSBkbyhzKQpkZXRlbnRvcihlcykgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIGRhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbywgZSBuw6NvIGZhcsOhIHF1YWxxdWVyIGFsdGVyYcOnw6NvLCBhbMOpbSBkYXF1ZWxhcwpjb25jZWRpZGFzIHBvciBlc3RhIGxpY2Vuw6dhLgoKBiblioteca Digital de Teses e Dissertaçõeshttps://repositorio.ufsm.br/ONGhttps://repositorio.ufsm.br/oai/requestatendimento.sib@ufsm.br||tedebc@gmail.comopendoar:2023-09-19T18:12:33Biblioteca Digital de Teses e Dissertações do UFSM - Universidade Federal de Santa Maria (UFSM)false
dc.title.por.fl_str_mv A Survey of Evolutionary Algorithms for Supervised Ensemble Learning
dc.title.alternative.eng.fl_str_mv A Survey of Evolutionary Algorithms for Supervised Ensemble Learning
title A Survey of Evolutionary Algorithms for Supervised Ensemble Learning
spellingShingle A Survey of Evolutionary Algorithms for Supervised Ensemble Learning
Cagnini, Henry E.L.
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWARE
title_short A Survey of Evolutionary Algorithms for Supervised Ensemble Learning
title_full A Survey of Evolutionary Algorithms for Supervised Ensemble Learning
title_fullStr A Survey of Evolutionary Algorithms for Supervised Ensemble Learning
title_full_unstemmed A Survey of Evolutionary Algorithms for Supervised Ensemble Learning
title_sort A Survey of Evolutionary Algorithms for Supervised Ensemble Learning
author Cagnini, Henry E.L.
author_facet Cagnini, Henry E.L.
Dˆores, Silvia C.N. das
Freitas, Alex A.
Barros, Rodrigo C.
author_role author
author2 Dˆores, Silvia C.N. das
Freitas, Alex A.
Barros, Rodrigo C.
author2_role author
author
author
dc.contributor.author.fl_str_mv Cagnini, Henry E.L.
Dˆores, Silvia C.N. das
Freitas, Alex A.
Barros, Rodrigo C.
dc.subject.cnpq.fl_str_mv CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWARE
topic CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::METODOLOGIA E TECNICAS DA COMPUTACAO::ENGENHARIA DE SOFTWARE
description This paper presents a comprehensive review of evolutionary algorithms that learn an ensemble of predictive models for supervised machine learning (classification and regression). We propose a detailed four-level taxonomy of studies in this area. The first level of the taxonomy categorizes studies based on which stage of the ensemble learning process is addressed by the evolutionary algorithm: the generation of base models, model selection, or the integration of outputs. The next three levels of the taxonomy further categorize studies based on methods used to address each stage. In addition, we categorize studies according to the main types of objectives optimized by the evolutionary algorithm, the type of base learner used and the type of evolutionary algorithm used. We also discuss controversial topics, like the pros and cons of the selection stage of ensemble learning, and the need for using a diversity measure for the ensemble’s members in the fitness function. Finally, as conclusions, we summarize our findings about patterns in the frequency of use of different methods, and suggest several new research directions for evolutionary ensemble learning.
publishDate 2023
dc.date.submitted.none.fl_str_mv 2023
dc.date.accessioned.fl_str_mv 2023-09-19T18:12:33Z
dc.date.available.fl_str_mv 2023-09-19T18:12:33Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/conferenceObject
format conferenceObject
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://repositorio.ufsm.br/handle/1/30244
url http://repositorio.ufsm.br/handle/1/30244
dc.language.iso.fl_str_mv eng
language eng
dc.relation.cnpq.fl_str_mv 100300300202
dc.relation.confidence.fl_str_mv 600
dc.relation.authority.fl_str_mv 86cbc9b0-021b-4f35-a831-8ddf7e6d1d8d
4147154f-b965-4bb4-a8b1-79f703d775fb
a60902b1-f190-4195-8bea-e9cc9da29288
68042187-8de3-4843-b08c-c1e6934c7b0b
dc.relation.ispartof.por.fl_str_mv The Knowledge Engineering Review
dc.rights.driver.fl_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
eu_rights_str_mv openAccess
dc.publisher.country.fl_str_mv Brasil
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações do UFSM
instname:Universidade Federal de Santa Maria (UFSM)
instacron:UFSM
instname_str Universidade Federal de Santa Maria (UFSM)
instacron_str UFSM
institution UFSM
reponame_str Biblioteca Digital de Teses e Dissertações do UFSM
collection Biblioteca Digital de Teses e Dissertações do UFSM
bitstream.url.fl_str_mv http://repositorio.ufsm.br/bitstream/1/30244/3/license.txt
http://repositorio.ufsm.br/bitstream/1/30244/2/license_rdf
http://repositorio.ufsm.br/bitstream/1/30244/1/_KER__survey_of_EA_for_EL.pdf
bitstream.checksum.fl_str_mv 2f0571ecee68693bd5cd3f17c1e075df
4460e5956bc1d1639be9ae6146a50347
3573f56a8eaea6bed1a73d2c6afafb34
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações do UFSM - Universidade Federal de Santa Maria (UFSM)
repository.mail.fl_str_mv atendimento.sib@ufsm.br||tedebc@gmail.com
_version_ 1791086171537801216