Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos

Detalhes bibliográficos
Autor(a) principal: Oliveira, Joel Alves de
Data de Publicação: 2020
Tipo de documento: Dissertação
Idioma: por
Título da fonte: Repositório Institucional da UFS
Texto Completo: https://ri.ufs.br/jspui/handle/riufs/14128
Resumo: In optimization problems there is a subset of problems that are defined as complex problems, which present high complexity models. For this class of problems there is an exhaustive number of possible combinations for the input variables of a system. Thus, evaluating these combinations is a humanly unfeasible process, so we use optimization mechanisms that aim to find the best solution, among which it is possible to quantify the degree of adequacy of the solutions to the needs in question. Generally, when dealing with problems with up to three objective functions, Evolutionary Algorithms are used to solve them. Another approach employed is the use of surrogates, which can be defined as mechanisms capable of learning the behavior of a given function. When using these mechanisms in complex problems, it is estimated that the high computational cost reduction to obtain the fitness values of the objective functions will be gained. Among the common surrogate mechanisms in the literature, the techniques of linear regression and machine learning stand out. The application of surrogates in problems with more than one objective function, multiobjective problems, requires the use of a learning model for each function, however, recent studies have been successful in employing a single surrogate for problems with more than one objective function. However, the use of surrogate in optimization problems with more than three objective functions is still a little explored area. Therefore, this work aims to propose and evaluate new approaches to surrogate training associated with Evolutionary Algorithms. Two frameworks were developed, one applied to the class of mono-objective problems and the other aimed at optimization problems with many objectives.The proposed frameworks are characterized by the use of different approaches to surrogate training and also different ways of using machine learning techniques. The frameworks were subjected to experiments using benchmark problems, where each configuration of the algorithms was executed for twenty times and stores the performance metrics. To confirm or refute the hypotheses, the Wilcoxon statistical test was applied. The results show that the machine learning techniques, Decision Tree and Random Forest when applied as a surrogate provide satisfactory results, in addition, the surrogate training methodologies proposed here, associated with the NSGA-II and SMPSO algorithms obtained better or equal results. than state-of-the-art algorithms (NSGA-II and MOEADD), in most of the experiments carried out.
id UFS-2_7c47d325125014d3b80fc5cbe4c7c80d
oai_identifier_str oai:ufs.br:riufs/14128
network_acronym_str UFS-2
network_name_str Repositório Institucional da UFS
repository_id_str
spelling Oliveira, Joel Alves deCarvalho, André Brito2021-04-27T17:16:53Z2021-04-27T17:16:53Z2020-02-14OLIVEIRA, Joel Alves de. Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos. 2020. 94 f. Dissertação (Mestrado em Ciência da Computação) - Universidade Federal de Sergipe, São Cristóvão, Sergipe, 2020.https://ri.ufs.br/jspui/handle/riufs/14128Autorização para publicação no Repositório da Universidade Federal de Sergipe (RI-UFS), concedida pelo autor.In optimization problems there is a subset of problems that are defined as complex problems, which present high complexity models. For this class of problems there is an exhaustive number of possible combinations for the input variables of a system. Thus, evaluating these combinations is a humanly unfeasible process, so we use optimization mechanisms that aim to find the best solution, among which it is possible to quantify the degree of adequacy of the solutions to the needs in question. Generally, when dealing with problems with up to three objective functions, Evolutionary Algorithms are used to solve them. Another approach employed is the use of surrogates, which can be defined as mechanisms capable of learning the behavior of a given function. When using these mechanisms in complex problems, it is estimated that the high computational cost reduction to obtain the fitness values of the objective functions will be gained. Among the common surrogate mechanisms in the literature, the techniques of linear regression and machine learning stand out. The application of surrogates in problems with more than one objective function, multiobjective problems, requires the use of a learning model for each function, however, recent studies have been successful in employing a single surrogate for problems with more than one objective function. However, the use of surrogate in optimization problems with more than three objective functions is still a little explored area. Therefore, this work aims to propose and evaluate new approaches to surrogate training associated with Evolutionary Algorithms. Two frameworks were developed, one applied to the class of mono-objective problems and the other aimed at optimization problems with many objectives.The proposed frameworks are characterized by the use of different approaches to surrogate training and also different ways of using machine learning techniques. The frameworks were subjected to experiments using benchmark problems, where each configuration of the algorithms was executed for twenty times and stores the performance metrics. To confirm or refute the hypotheses, the Wilcoxon statistical test was applied. The results show that the machine learning techniques, Decision Tree and Random Forest when applied as a surrogate provide satisfactory results, in addition, the surrogate training methodologies proposed here, associated with the NSGA-II and SMPSO algorithms obtained better or equal results. than state-of-the-art algorithms (NSGA-II and MOEADD), in most of the experiments carried out.Em problemas de otimização existem um subconjunto de problemas que são definidos como problemas complexos, os quais apresentam modelagens de complexidade alta. Para essa classe de problemas existe um número exaustivo de possíveis combinações para as variáveis de entrada de um sistema. Assim, avaliar essas combinações é um processo humanamente inviável, então recorre-se a mecanismos de otimização que visam encontrar a melhor solução, dentre os quais é possível quantificar o grau de adequação das soluções às necessidades em causa. Geralmente, quando se tratam de problemas com até três funções objetivos são empregados Algoritmos Evolutivos para resolvê-los. Outra abordagem empregada é o uso de surrogates, os quais podem ser definidos como mecanismos capazes de aprender o comportamento de uma dada função. Ao usar esses mecanismos em problemas complexos estima-se obter como ganho a redução do alto custo computacional para computar os valores de fitness das funções objetivos. Dentre os mecanismos de surrogate comuns na literatura destacam-se as técnicas de regressão linear e aprendizagem de máquina. A aplicação de surrogates em problemas com mais de uma função objetivo, problemas multiobjetivo, requer o uso de um modelo de aprendizagem para cada função, entretanto, recentes estudos têm obtido êxito em empregar um único surrogate para problemas com mais de uma função objetivo. Porém o uso de surrogate em problemas de otimização com mais de três funções objetivos ainda é uma área pouco explorada. Diante disso, esse trabalho tem como objetivo propor e avaliar novas abordagens de treinamento de surrogate associados a Algoritmos Evolutivos. Foram desenvolvidos dois frameworks, um aplicado a classe de problemas mono-objetivo e outro voltado para problemas de otimização com muitos objetivos. Os frameworks propostos tem como característica o emprego de diferentes abordagens de treinamento de surrogate e também diferentes maneiras de uso de técnicas de aprendizagem de máquina. Os frameworks foram submetidos a experimentos usando problemas benchmark, onde cada configuração dos algoritmos foi execultada por vinte vezes e armazendas as métricas de desempenho. Para confirmar ou refutar as hipóteses, foi aplicado o teste estatístico de Wilcoxon. Os resultados evidenciam que as técnicas de aprendizagens de máquinas, Arvore de Decisão e Random Forest quando aplicadas como surrogate proporcionam resultados satisfatórios, além disso, as metologias de treinamento de surrogate aqui propostas, associadas aos algoritmos NSGA-II e SMPSO obtiveram resultados melhores ou iguais que os algoritmos do estado da arte (NSGA-II e MOEADD), na maioria dos experimentos realizados.São Cristóvão, SEporAprendizagem de máquinaAlgoritmos evolutivosSurrogateProblemas de otimização complexosComputer scienceMachine learningEvolutive algorithmsCIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAOAvaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivosinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisPós-Graduação em Ciência da ComputaçãoUniversidade Federal de Sergipereponame:Repositório Institucional da UFSinstname:Universidade Federal de Sergipe (UFS)instacron:UFSinfo:eu-repo/semantics/openAccessTEXTJOEL_ALVES_OLIVEIRA.pdf.txtJOEL_ALVES_OLIVEIRA.pdf.txtExtracted texttext/plain178125https://ri.ufs.br/jspui/bitstream/riufs/14128/3/JOEL_ALVES_OLIVEIRA.pdf.txtb134775f4dd848439cee0e45fccfe613MD53THUMBNAILJOEL_ALVES_OLIVEIRA.pdf.jpgJOEL_ALVES_OLIVEIRA.pdf.jpgGenerated Thumbnailimage/jpeg1465https://ri.ufs.br/jspui/bitstream/riufs/14128/4/JOEL_ALVES_OLIVEIRA.pdf.jpgb08896552f59dc77d30e831bc48a4c91MD54LICENSElicense.txtlicense.txttext/plain; charset=utf-81475https://ri.ufs.br/jspui/bitstream/riufs/14128/1/license.txt098cbbf65c2c15e1fb2e49c5d306a44cMD51ORIGINALJOEL_ALVES_OLIVEIRA.pdfJOEL_ALVES_OLIVEIRA.pdfapplication/pdf2628083https://ri.ufs.br/jspui/bitstream/riufs/14128/2/JOEL_ALVES_OLIVEIRA.pdf7704caafea38f22daf574c55c8b2ffe4MD52riufs/141282021-04-28 15:57:14.886oai:ufs.br:riufs/14128TElDRU7Dh0EgREUgRElTVFJJQlVJw4fDg08gTsODTy1FWENMVVNJVkEKCkNvbSBhIGFwcmVzZW50YcOnw6NvIGRlc3RhIGxpY2Vuw6dhLCB2b2PDqiAobyBhdXRvcihlcykgb3UgbyB0aXR1bGFyIGRvcyBkaXJlaXRvcyBkZSBhdXRvcikgY29uY2VkZSDDoCBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkZSBTZXJnaXBlIG8gZGlyZWl0byBuw6NvLWV4Y2x1c2l2byBkZSByZXByb2R1emlyIHNldSB0cmFiYWxobyBubyBmb3JtYXRvIGVsZXRyw7RuaWNvLCBpbmNsdWluZG8gb3MgZm9ybWF0b3Mgw6F1ZGlvIG91IHbDrWRlby4KClZvY8OqIGNvbmNvcmRhIHF1ZSBhIFVuaXZlcnNpZGFkZSBGZWRlcmFsIGRlIFNlcmdpcGUgcG9kZSwgc2VtIGFsdGVyYXIgbyBjb250ZcO6ZG8sIHRyYW5zcG9yIHNldSB0cmFiYWxobyBwYXJhIHF1YWxxdWVyIG1laW8gb3UgZm9ybWF0byBwYXJhIGZpbnMgZGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIHRhbWLDqW0gY29uY29yZGEgcXVlIGEgVW5pdmVyc2lkYWRlIEZlZGVyYWwgZGUgU2VyZ2lwZSBwb2RlIG1hbnRlciBtYWlzIGRlIHVtYSBjw7NwaWEgZGUgc2V1IHRyYWJhbGhvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIGRlY2xhcmEgcXVlIHNldSB0cmFiYWxobyDDqSBvcmlnaW5hbCBlIHF1ZSB2b2PDqiB0ZW0gbyBwb2RlciBkZSBjb25jZWRlciBvcyBkaXJlaXRvcyBjb250aWRvcyBuZXN0YSBsaWNlbsOnYS4gVm9jw6ogdGFtYsOpbSBkZWNsYXJhIHF1ZSBvIGRlcMOzc2l0bywgcXVlIHNlamEgZGUgc2V1IGNvbmhlY2ltZW50bywgbsOjbyBpbmZyaW5nZSBkaXJlaXRvcyBhdXRvcmFpcyBkZSBuaW5ndcOpbS4KCkNhc28gbyB0cmFiYWxobyBjb250ZW5oYSBtYXRlcmlhbCBxdWUgdm9jw6ogbsOjbyBwb3NzdWkgYSB0aXR1bGFyaWRhZGUgZG9zIGRpcmVpdG9zIGF1dG9yYWlzLCB2b2PDqiBkZWNsYXJhIHF1ZSBvYnRldmUgYSBwZXJtaXNzw6NvIGlycmVzdHJpdGEgZG8gZGV0ZW50b3IgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIHBhcmEgY29uY2VkZXIgw6AgVW5pdmVyc2lkYWRlIEZlZGVyYWwgZGUgU2VyZ2lwZSBvcyBkaXJlaXRvcyBhcHJlc2VudGFkb3MgbmVzdGEgbGljZW7Dp2EsIGUgcXVlIGVzc2UgbWF0ZXJpYWwgZGUgcHJvcHJpZWRhZGUgZGUgdGVyY2Vpcm9zIGVzdMOhIGNsYXJhbWVudGUgaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3Ugbm8gY29udGXDumRvLgoKQSBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkZSBTZXJnaXBlIHNlIGNvbXByb21ldGUgYSBpZGVudGlmaWNhciBjbGFyYW1lbnRlIG8gc2V1IG5vbWUocykgb3UgbyhzKSBub21lKHMpIGRvKHMpIApkZXRlbnRvcihlcykgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIGRvIHRyYWJhbGhvLCBlIG7Do28gZmFyw6EgcXVhbHF1ZXIgYWx0ZXJhw6fDo28sIGFsw6ltIGRhcXVlbGFzIGNvbmNlZGlkYXMgcG9yIGVzdGEgbGljZW7Dp2EuIAo=Repositório InstitucionalPUBhttps://ri.ufs.br/oai/requestrepositorio@academico.ufs.bropendoar:2021-04-28T18:57:14Repositório Institucional da UFS - Universidade Federal de Sergipe (UFS)false
dc.title.pt_BR.fl_str_mv Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos
title Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos
spellingShingle Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos
Oliveira, Joel Alves de
Aprendizagem de máquina
Algoritmos evolutivos
Surrogate
Problemas de otimização complexos
Computer science
Machine learning
Evolutive algorithms
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
title_short Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos
title_full Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos
title_fullStr Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos
title_full_unstemmed Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos
title_sort Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos
author Oliveira, Joel Alves de
author_facet Oliveira, Joel Alves de
author_role author
dc.contributor.author.fl_str_mv Oliveira, Joel Alves de
dc.contributor.advisor1.fl_str_mv Carvalho, André Brito
contributor_str_mv Carvalho, André Brito
dc.subject.por.fl_str_mv Aprendizagem de máquina
Algoritmos evolutivos
Surrogate
Problemas de otimização complexos
topic Aprendizagem de máquina
Algoritmos evolutivos
Surrogate
Problemas de otimização complexos
Computer science
Machine learning
Evolutive algorithms
CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
dc.subject.eng.fl_str_mv Computer science
Machine learning
Evolutive algorithms
dc.subject.cnpq.fl_str_mv CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
description In optimization problems there is a subset of problems that are defined as complex problems, which present high complexity models. For this class of problems there is an exhaustive number of possible combinations for the input variables of a system. Thus, evaluating these combinations is a humanly unfeasible process, so we use optimization mechanisms that aim to find the best solution, among which it is possible to quantify the degree of adequacy of the solutions to the needs in question. Generally, when dealing with problems with up to three objective functions, Evolutionary Algorithms are used to solve them. Another approach employed is the use of surrogates, which can be defined as mechanisms capable of learning the behavior of a given function. When using these mechanisms in complex problems, it is estimated that the high computational cost reduction to obtain the fitness values of the objective functions will be gained. Among the common surrogate mechanisms in the literature, the techniques of linear regression and machine learning stand out. The application of surrogates in problems with more than one objective function, multiobjective problems, requires the use of a learning model for each function, however, recent studies have been successful in employing a single surrogate for problems with more than one objective function. However, the use of surrogate in optimization problems with more than three objective functions is still a little explored area. Therefore, this work aims to propose and evaluate new approaches to surrogate training associated with Evolutionary Algorithms. Two frameworks were developed, one applied to the class of mono-objective problems and the other aimed at optimization problems with many objectives.The proposed frameworks are characterized by the use of different approaches to surrogate training and also different ways of using machine learning techniques. The frameworks were subjected to experiments using benchmark problems, where each configuration of the algorithms was executed for twenty times and stores the performance metrics. To confirm or refute the hypotheses, the Wilcoxon statistical test was applied. The results show that the machine learning techniques, Decision Tree and Random Forest when applied as a surrogate provide satisfactory results, in addition, the surrogate training methodologies proposed here, associated with the NSGA-II and SMPSO algorithms obtained better or equal results. than state-of-the-art algorithms (NSGA-II and MOEADD), in most of the experiments carried out.
publishDate 2020
dc.date.issued.fl_str_mv 2020-02-14
dc.date.accessioned.fl_str_mv 2021-04-27T17:16:53Z
dc.date.available.fl_str_mv 2021-04-27T17:16:53Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv OLIVEIRA, Joel Alves de. Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos. 2020. 94 f. Dissertação (Mestrado em Ciência da Computação) - Universidade Federal de Sergipe, São Cristóvão, Sergipe, 2020.
dc.identifier.uri.fl_str_mv https://ri.ufs.br/jspui/handle/riufs/14128
dc.identifier.license.pt_BR.fl_str_mv Autorização para publicação no Repositório da Universidade Federal de Sergipe (RI-UFS), concedida pelo autor.
identifier_str_mv OLIVEIRA, Joel Alves de. Avaliação de técnicas de aprendizagem de máquina como surrogate na otimização com muitos objetivos. 2020. 94 f. Dissertação (Mestrado em Ciência da Computação) - Universidade Federal de Sergipe, São Cristóvão, Sergipe, 2020.
Autorização para publicação no Repositório da Universidade Federal de Sergipe (RI-UFS), concedida pelo autor.
url https://ri.ufs.br/jspui/handle/riufs/14128
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.program.fl_str_mv Pós-Graduação em Ciência da Computação
dc.publisher.initials.fl_str_mv Universidade Federal de Sergipe
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFS
instname:Universidade Federal de Sergipe (UFS)
instacron:UFS
instname_str Universidade Federal de Sergipe (UFS)
instacron_str UFS
institution UFS
reponame_str Repositório Institucional da UFS
collection Repositório Institucional da UFS
bitstream.url.fl_str_mv https://ri.ufs.br/jspui/bitstream/riufs/14128/3/JOEL_ALVES_OLIVEIRA.pdf.txt
https://ri.ufs.br/jspui/bitstream/riufs/14128/4/JOEL_ALVES_OLIVEIRA.pdf.jpg
https://ri.ufs.br/jspui/bitstream/riufs/14128/1/license.txt
https://ri.ufs.br/jspui/bitstream/riufs/14128/2/JOEL_ALVES_OLIVEIRA.pdf
bitstream.checksum.fl_str_mv b134775f4dd848439cee0e45fccfe613
b08896552f59dc77d30e831bc48a4c91
098cbbf65c2c15e1fb2e49c5d306a44c
7704caafea38f22daf574c55c8b2ffe4
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFS - Universidade Federal de Sergipe (UFS)
repository.mail.fl_str_mv repositorio@academico.ufs.br
_version_ 1802110781282582528