ARTificial intelligence raters. Neural networks for rating pictorial expression

Detalhes bibliográficos
Autor(a) principal: Gengenbach, Thomas
Data de Publicação: 2022
Outros Autores: Schoch, Kerstin
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: https://doi.org/10.34632/jsta.2022.10196
Resumo: Previous studies on classification of fine art show that features of paintings can be captured and categorized using machine learning approaches. This progress can also benefit art psychology by facilitating data collection on artworks without the need to recruit experts as raters. In this study a machine learning approach is used to predict the ratings of RizbA, a Rating instrument for two-dimensional pictorial works. Based on a pre-trained model, the algorithm was fine-tuned via transfer learning on 886 pictorial works by contemporary professional artists and non-professionals. As quality criterion, artificial intelligence raters (ART) are compared with generic raters (GR) created from the real human expert raters, using error rate and mean squared error (MSE). ART ratings have been found to have the same error range as randomly chosen human ratings. Therefore, they can be seen as equivalent to real human expert raters for almost all items in RizbA. Further training with more data will close the gap to the human raters on all items.
id RCAP_e749ee9cfc92f0dea39b61f604405b4b
oai_identifier_str oai:ojs.revistas.ucp.pt:article/10196
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling ARTificial intelligence raters. Neural networks for rating pictorial expressionPrevious studies on classification of fine art show that features of paintings can be captured and categorized using machine learning approaches. This progress can also benefit art psychology by facilitating data collection on artworks without the need to recruit experts as raters. In this study a machine learning approach is used to predict the ratings of RizbA, a Rating instrument for two-dimensional pictorial works. Based on a pre-trained model, the algorithm was fine-tuned via transfer learning on 886 pictorial works by contemporary professional artists and non-professionals. As quality criterion, artificial intelligence raters (ART) are compared with generic raters (GR) created from the real human expert raters, using error rate and mean squared error (MSE). ART ratings have been found to have the same error range as randomly chosen human ratings. Therefore, they can be seen as equivalent to real human expert raters for almost all items in RizbA. Further training with more data will close the gap to the human raters on all items.Universidade Católica Portuguesa2022-04-30T00:00:00Zjournal articleinfo:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdfhttps://doi.org/10.34632/jsta.2022.10196oai:ojs.revistas.ucp.pt:article/10196Journal of Science and Technology of the Arts; Vol 14 No 1 (2022); 49-71Journal of Science and Technology of the Arts; v. 14 n. 1 (2022); 49-712183-00881646-979810.34632/jsta.2022.14.1reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAPenghttps://revistas.ucp.pt/index.php/jsta/article/view/10196https://doi.org/10.34632/jsta.2022.10196https://revistas.ucp.pt/index.php/jsta/article/view/10196/11141Copyright (c) 2022 Thomas Gengenbach, Kerstin Schochhttp://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessGengenbach, ThomasSchoch, Kerstin2022-09-22T16:19:30Zoai:ojs.revistas.ucp.pt:article/10196Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T15:59:08.127277Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv ARTificial intelligence raters. Neural networks for rating pictorial expression
title ARTificial intelligence raters. Neural networks for rating pictorial expression
spellingShingle ARTificial intelligence raters. Neural networks for rating pictorial expression
Gengenbach, Thomas
title_short ARTificial intelligence raters. Neural networks for rating pictorial expression
title_full ARTificial intelligence raters. Neural networks for rating pictorial expression
title_fullStr ARTificial intelligence raters. Neural networks for rating pictorial expression
title_full_unstemmed ARTificial intelligence raters. Neural networks for rating pictorial expression
title_sort ARTificial intelligence raters. Neural networks for rating pictorial expression
author Gengenbach, Thomas
author_facet Gengenbach, Thomas
Schoch, Kerstin
author_role author
author2 Schoch, Kerstin
author2_role author
dc.contributor.author.fl_str_mv Gengenbach, Thomas
Schoch, Kerstin
description Previous studies on classification of fine art show that features of paintings can be captured and categorized using machine learning approaches. This progress can also benefit art psychology by facilitating data collection on artworks without the need to recruit experts as raters. In this study a machine learning approach is used to predict the ratings of RizbA, a Rating instrument for two-dimensional pictorial works. Based on a pre-trained model, the algorithm was fine-tuned via transfer learning on 886 pictorial works by contemporary professional artists and non-professionals. As quality criterion, artificial intelligence raters (ART) are compared with generic raters (GR) created from the real human expert raters, using error rate and mean squared error (MSE). ART ratings have been found to have the same error range as randomly chosen human ratings. Therefore, they can be seen as equivalent to real human expert raters for almost all items in RizbA. Further training with more data will close the gap to the human raters on all items.
publishDate 2022
dc.date.none.fl_str_mv 2022-04-30T00:00:00Z
dc.type.driver.fl_str_mv journal article
info:eu-repo/semantics/article
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://doi.org/10.34632/jsta.2022.10196
oai:ojs.revistas.ucp.pt:article/10196
url https://doi.org/10.34632/jsta.2022.10196
identifier_str_mv oai:ojs.revistas.ucp.pt:article/10196
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv https://revistas.ucp.pt/index.php/jsta/article/view/10196
https://doi.org/10.34632/jsta.2022.10196
https://revistas.ucp.pt/index.php/jsta/article/view/10196/11141
dc.rights.driver.fl_str_mv Copyright (c) 2022 Thomas Gengenbach, Kerstin Schoch
http://creativecommons.org/licenses/by/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Copyright (c) 2022 Thomas Gengenbach, Kerstin Schoch
http://creativecommons.org/licenses/by/4.0
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidade Católica Portuguesa
publisher.none.fl_str_mv Universidade Católica Portuguesa
dc.source.none.fl_str_mv Journal of Science and Technology of the Arts; Vol 14 No 1 (2022); 49-71
Journal of Science and Technology of the Arts; v. 14 n. 1 (2022); 49-71
2183-0088
1646-9798
10.34632/jsta.2022.14.1
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799130458144899072