AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolution
Autor(a) principal: | |
---|---|
Data de Publicação: | 2023 |
Outros Autores: | |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | https://hdl.handle.net/1822/87094 |
Resumo: | One-Class Classification (OCC) corresponds to a subclass of unsupervised Machine Learning (ML) that is valuable when labeled data is non-existent. In this paper, we present AutoOC, a computationally efficient Grammatical Evolution (GE) approach that automatically searches for OCC models. AutoOC assumes a multi-objective optimization, aiming to increase the OCC predictive performance while reducing the ML training time. AutoOC also includes two execution speedup mechanisms, a periodic training sampling, and a multi-core fitness evaluation. In particular, we study two AutoOC variants: a pure Neuroevolution (NE) setup that optimizes two types of deep learning models, namely dense Autoencoder (AE) and Variational Autoencoder (VAE); and a general Automated Machine Learning (AutoML) ALL setup that considers five distinct OCC base learners, specifically Isolation Forest (IF), Local Outlier Factor (LOF), One-Class SVM (OC-SVM), AE and VAE. Several experiments were conducted, using eight public OpenML datasets and two validation scenarios (unsupervised and supervised). The results show that AutoOC requires a reasonable amount of execution time and tends to obtain lightweight OCC models. Moreover, AutoOC provides quality predictive results, outperforming a baseline IF for all analyzed datasets and surpassing the best supervised OpenML human modeling for two datasets. |
id |
RCAP_a3a82081aa40f483d63c9866b8724750 |
---|---|
oai_identifier_str |
oai:repositorium.sdum.uminho.pt:1822/87094 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolutionAutomated machine learningDeep autoencodersGrammatical evolutionMulti-objective optimizationOne-class classificationEngenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e InformáticaOne-Class Classification (OCC) corresponds to a subclass of unsupervised Machine Learning (ML) that is valuable when labeled data is non-existent. In this paper, we present AutoOC, a computationally efficient Grammatical Evolution (GE) approach that automatically searches for OCC models. AutoOC assumes a multi-objective optimization, aiming to increase the OCC predictive performance while reducing the ML training time. AutoOC also includes two execution speedup mechanisms, a periodic training sampling, and a multi-core fitness evaluation. In particular, we study two AutoOC variants: a pure Neuroevolution (NE) setup that optimizes two types of deep learning models, namely dense Autoencoder (AE) and Variational Autoencoder (VAE); and a general Automated Machine Learning (AutoML) ALL setup that considers five distinct OCC base learners, specifically Isolation Forest (IF), Local Outlier Factor (LOF), One-Class SVM (OC-SVM), AE and VAE. Several experiments were conducted, using eight public OpenML datasets and two validation scenarios (unsupervised and supervised). The results show that AutoOC requires a reasonable amount of execution time and tends to obtain lightweight OCC models. Moreover, AutoOC provides quality predictive results, outperforming a baseline IF for all analyzed datasets and surpassing the best supervised OpenML human modeling for two datasets.- (undefined)Elsevier B.V.Universidade do MinhoFerreira, Luís Fernando FariaCortez, Paulo20232023-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/1822/87094engFerreira, L., & Cortez, P. (2023, September). AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolution. Applied Soft Computing. Elsevier BV. http://doi.org/10.1016/j.asoc.2023.1104961568-494610.1016/j.asoc.2023.110496https://www.sciencedirect.com/science/article/pii/S1568494623005148info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-10-28T01:19:54Zoai:repositorium.sdum.uminho.pt:1822/87094Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T21:26:01.445720Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolution |
title |
AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolution |
spellingShingle |
AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolution Ferreira, Luís Fernando Faria Automated machine learning Deep autoencoders Grammatical evolution Multi-objective optimization One-class classification Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática |
title_short |
AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolution |
title_full |
AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolution |
title_fullStr |
AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolution |
title_full_unstemmed |
AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolution |
title_sort |
AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolution |
author |
Ferreira, Luís Fernando Faria |
author_facet |
Ferreira, Luís Fernando Faria Cortez, Paulo |
author_role |
author |
author2 |
Cortez, Paulo |
author2_role |
author |
dc.contributor.none.fl_str_mv |
Universidade do Minho |
dc.contributor.author.fl_str_mv |
Ferreira, Luís Fernando Faria Cortez, Paulo |
dc.subject.por.fl_str_mv |
Automated machine learning Deep autoencoders Grammatical evolution Multi-objective optimization One-class classification Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática |
topic |
Automated machine learning Deep autoencoders Grammatical evolution Multi-objective optimization One-class classification Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática |
description |
One-Class Classification (OCC) corresponds to a subclass of unsupervised Machine Learning (ML) that is valuable when labeled data is non-existent. In this paper, we present AutoOC, a computationally efficient Grammatical Evolution (GE) approach that automatically searches for OCC models. AutoOC assumes a multi-objective optimization, aiming to increase the OCC predictive performance while reducing the ML training time. AutoOC also includes two execution speedup mechanisms, a periodic training sampling, and a multi-core fitness evaluation. In particular, we study two AutoOC variants: a pure Neuroevolution (NE) setup that optimizes two types of deep learning models, namely dense Autoencoder (AE) and Variational Autoencoder (VAE); and a general Automated Machine Learning (AutoML) ALL setup that considers five distinct OCC base learners, specifically Isolation Forest (IF), Local Outlier Factor (LOF), One-Class SVM (OC-SVM), AE and VAE. Several experiments were conducted, using eight public OpenML datasets and two validation scenarios (unsupervised and supervised). The results show that AutoOC requires a reasonable amount of execution time and tends to obtain lightweight OCC models. Moreover, AutoOC provides quality predictive results, outperforming a baseline IF for all analyzed datasets and surpassing the best supervised OpenML human modeling for two datasets. |
publishDate |
2023 |
dc.date.none.fl_str_mv |
2023 2023-01-01T00:00:00Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://hdl.handle.net/1822/87094 |
url |
https://hdl.handle.net/1822/87094 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
Ferreira, L., & Cortez, P. (2023, September). AutoOC: Automated multi-objective design of deep autoencoders and one-class classifiers using grammatical evolution. Applied Soft Computing. Elsevier BV. http://doi.org/10.1016/j.asoc.2023.110496 1568-4946 10.1016/j.asoc.2023.110496 https://www.sciencedirect.com/science/article/pii/S1568494623005148 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Elsevier B.V. |
publisher.none.fl_str_mv |
Elsevier B.V. |
dc.source.none.fl_str_mv |
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799134141809164288 |