Ensembled Geometric Semantic Genetic Programming: An ensemble-based initialization technique for Geometric Semantic Genetic Programming
Autor(a) principal: | |
---|---|
Data de Publicação: | 2022 |
Tipo de documento: | Dissertação |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | http://hdl.handle.net/10362/140850 |
Resumo: | Dissertation presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced Analytics |
id |
RCAP_dcee58c758451a919b3527a19c055efb |
---|---|
oai_identifier_str |
oai:run.unl.pt:10362/140850 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
Ensembled Geometric Semantic Genetic Programming: An ensemble-based initialization technique for Geometric Semantic Genetic ProgrammingGenetic ProgrammingGeometric Semantic Genetic ProgrammingInitialization methodsEnsemble methodsMeta-learningMachine LearningEvolutionary AlgorithmsDissertation presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced AnalyticsMachine learning is a scientific field that seeks to empower computers with the ability to learn without having to be explicitly programmed. Given the ever growing number of sophisticated intelligent machine learning algorithms, investigators can find themselves “stuck” in a time and resources consuming process of model searching, tuning and testing. Bearing this in mind, Ensemble Methods and meta-learning algorithms have emerged as an attempt to automate the process of combining several different models in an intelligent, adaptive way. Within the field of machine learning, a specific set of algorithms, called Evolutionary Algorithms, mimic Darwin’s Theory of Evolution. As their name indicates, these algorithms incorporate concepts of evolution to the task learning process. They do so by evolving a set of individuals (i.e., possible solutions to a given problem) under pressures of natural selection and "survival of the fittest" mechanisms. Genetic Programming (GP) is an Evolutionary Algorithm that evolves computer programs (i.e., individuals) in order to perform a mapping between input and output features. Its extension, Geometric Semantic Genetic Programming (GSGP), allows us to perform the evolution and variation of the individuals on the semantic space (i.e., the space in which the output vectors lay) rather than on their syntax based structure. The generation of the initial population, commonly known as the initialization, has been proven to be a key factor for both GP and GSGP’s performance. This work proposes an initialization technique for GSGP that utilizes the combinatory power of Ensemble Methods in order to generate a “fit” initial population based on the predictions of a wide variety of machine learning algorithms, called Base Learners, making use of GSGP’s ability to evolve individuals solely based on their semantics (i.e., predictions). This initialization technique is called Ensembled Geometric Semantic Genetic Programming as it utilizes GSGP as a learning combiner that merges the knowledge obtained from different machine learning techniques by evolving their semantics via crossing between and mutating them over the course of several generations. The performance of the proposed initialization method (EGSGP) was tested on three different case studies. Results show that EGSGP significantly outperforms traditional GSGP (with the exception of one case study where EGSGP’s improved performance in comparison to GSGP did not translate into statistically significant results). Additionally, results show that EGSGP produces better results than the best base learner from the initial population being, thus, able to improve it. This improvement was present in all case studies only yielding, however, statistically significant results in one of them.Vanneschi, LeonardoRUNRosenfeld, Liah2022-06-27T13:50:46Z2022-05-042022-05-04T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10362/140850TID:203028422enginfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-03-11T05:18:02Zoai:run.unl.pt:10362/140850Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T03:49:48.360843Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
Ensembled Geometric Semantic Genetic Programming: An ensemble-based initialization technique for Geometric Semantic Genetic Programming |
title |
Ensembled Geometric Semantic Genetic Programming: An ensemble-based initialization technique for Geometric Semantic Genetic Programming |
spellingShingle |
Ensembled Geometric Semantic Genetic Programming: An ensemble-based initialization technique for Geometric Semantic Genetic Programming Rosenfeld, Liah Genetic Programming Geometric Semantic Genetic Programming Initialization methods Ensemble methods Meta-learning Machine Learning Evolutionary Algorithms |
title_short |
Ensembled Geometric Semantic Genetic Programming: An ensemble-based initialization technique for Geometric Semantic Genetic Programming |
title_full |
Ensembled Geometric Semantic Genetic Programming: An ensemble-based initialization technique for Geometric Semantic Genetic Programming |
title_fullStr |
Ensembled Geometric Semantic Genetic Programming: An ensemble-based initialization technique for Geometric Semantic Genetic Programming |
title_full_unstemmed |
Ensembled Geometric Semantic Genetic Programming: An ensemble-based initialization technique for Geometric Semantic Genetic Programming |
title_sort |
Ensembled Geometric Semantic Genetic Programming: An ensemble-based initialization technique for Geometric Semantic Genetic Programming |
author |
Rosenfeld, Liah |
author_facet |
Rosenfeld, Liah |
author_role |
author |
dc.contributor.none.fl_str_mv |
Vanneschi, Leonardo RUN |
dc.contributor.author.fl_str_mv |
Rosenfeld, Liah |
dc.subject.por.fl_str_mv |
Genetic Programming Geometric Semantic Genetic Programming Initialization methods Ensemble methods Meta-learning Machine Learning Evolutionary Algorithms |
topic |
Genetic Programming Geometric Semantic Genetic Programming Initialization methods Ensemble methods Meta-learning Machine Learning Evolutionary Algorithms |
description |
Dissertation presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced Analytics |
publishDate |
2022 |
dc.date.none.fl_str_mv |
2022-06-27T13:50:46Z 2022-05-04 2022-05-04T00:00:00Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/masterThesis |
format |
masterThesis |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://hdl.handle.net/10362/140850 TID:203028422 |
url |
http://hdl.handle.net/10362/140850 |
identifier_str_mv |
TID:203028422 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.source.none.fl_str_mv |
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799138095859236864 |