Visual complexity modelling based on image features fusion of multiple kernels

Detalhes bibliográficos
Autor(a) principal: Fernandez-Lozano, Carlos
Data de Publicação: 2019
Outros Autores: Carballal, Adrian, Machado, Penousal, Santos, Antonino, Romero, Juan
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10316/107208
https://doi.org/10.7717/peerj.7075
Resumo: Humans' perception of visual complexity is often regarded as one of the key principles of aesthetic order, and is intimately related to the physiological, neurological and, possibly, psychological characteristics of the human mind. For these reasons, creating accurate computational models of visual complexity is a demanding task. Building upon on previous work in the field (Forsythe et al., 2011; Machado et al., 2015) we explore the use of Machine Learning techniques to create computational models of visual complexity. For that purpose, we use a dataset composed of 800 visual stimuli divided into five categories, describing each stimulus by 329 features based on edge detection, compression error and Zipf's law. In an initial stage, a comparative analysis of representative state-of-the-art Machine Learning approaches is performed. Subsequently, we conduct an exhaustive outlier analysis. We analyze the impact of removing the extreme outliers, concluding that Feature Selection Multiple Kernel Learning obtains the best results, yielding an average correlation to humans' perception of complexity of 0.71 with only twenty-two features. These results outperform the current state-of-the-art, showing the potential of this technique for regression.
id RCAP_01a9d4e8025067ab07041c234da5d225
oai_identifier_str oai:estudogeral.uc.pt:10316/107208
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Visual complexity modelling based on image features fusion of multiple kernelsCorrelationMachine learningZipf's lawCompression errorVisual stimuliVisual complexityHumans' perception of visual complexity is often regarded as one of the key principles of aesthetic order, and is intimately related to the physiological, neurological and, possibly, psychological characteristics of the human mind. For these reasons, creating accurate computational models of visual complexity is a demanding task. Building upon on previous work in the field (Forsythe et al., 2011; Machado et al., 2015) we explore the use of Machine Learning techniques to create computational models of visual complexity. For that purpose, we use a dataset composed of 800 visual stimuli divided into five categories, describing each stimulus by 329 features based on edge detection, compression error and Zipf's law. In an initial stage, a comparative analysis of representative state-of-the-art Machine Learning approaches is performed. Subsequently, we conduct an exhaustive outlier analysis. We analyze the impact of removing the extreme outliers, concluding that Feature Selection Multiple Kernel Learning obtains the best results, yielding an average correlation to humans' perception of complexity of 0.71 with only twenty-two features. These results outperform the current state-of-the-art, showing the potential of this technique for regression.PeerJ2019info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttp://hdl.handle.net/10316/107208http://hdl.handle.net/10316/107208https://doi.org/10.7717/peerj.7075eng2167-8359Fernandez-Lozano, CarlosCarballal, AdrianMachado, PenousalSantos, AntoninoRomero, Juaninfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-06-15T07:51:28Zoai:estudogeral.uc.pt:10316/107208Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T21:23:34.133404Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Visual complexity modelling based on image features fusion of multiple kernels
title Visual complexity modelling based on image features fusion of multiple kernels
spellingShingle Visual complexity modelling based on image features fusion of multiple kernels
Fernandez-Lozano, Carlos
Correlation
Machine learning
Zipf's law
Compression error
Visual stimuli
Visual complexity
title_short Visual complexity modelling based on image features fusion of multiple kernels
title_full Visual complexity modelling based on image features fusion of multiple kernels
title_fullStr Visual complexity modelling based on image features fusion of multiple kernels
title_full_unstemmed Visual complexity modelling based on image features fusion of multiple kernels
title_sort Visual complexity modelling based on image features fusion of multiple kernels
author Fernandez-Lozano, Carlos
author_facet Fernandez-Lozano, Carlos
Carballal, Adrian
Machado, Penousal
Santos, Antonino
Romero, Juan
author_role author
author2 Carballal, Adrian
Machado, Penousal
Santos, Antonino
Romero, Juan
author2_role author
author
author
author
dc.contributor.author.fl_str_mv Fernandez-Lozano, Carlos
Carballal, Adrian
Machado, Penousal
Santos, Antonino
Romero, Juan
dc.subject.por.fl_str_mv Correlation
Machine learning
Zipf's law
Compression error
Visual stimuli
Visual complexity
topic Correlation
Machine learning
Zipf's law
Compression error
Visual stimuli
Visual complexity
description Humans' perception of visual complexity is often regarded as one of the key principles of aesthetic order, and is intimately related to the physiological, neurological and, possibly, psychological characteristics of the human mind. For these reasons, creating accurate computational models of visual complexity is a demanding task. Building upon on previous work in the field (Forsythe et al., 2011; Machado et al., 2015) we explore the use of Machine Learning techniques to create computational models of visual complexity. For that purpose, we use a dataset composed of 800 visual stimuli divided into five categories, describing each stimulus by 329 features based on edge detection, compression error and Zipf's law. In an initial stage, a comparative analysis of representative state-of-the-art Machine Learning approaches is performed. Subsequently, we conduct an exhaustive outlier analysis. We analyze the impact of removing the extreme outliers, concluding that Feature Selection Multiple Kernel Learning obtains the best results, yielding an average correlation to humans' perception of complexity of 0.71 with only twenty-two features. These results outperform the current state-of-the-art, showing the potential of this technique for regression.
publishDate 2019
dc.date.none.fl_str_mv 2019
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10316/107208
http://hdl.handle.net/10316/107208
https://doi.org/10.7717/peerj.7075
url http://hdl.handle.net/10316/107208
https://doi.org/10.7717/peerj.7075
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 2167-8359
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv PeerJ
publisher.none.fl_str_mv PeerJ
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799134122275241984