ARTificial intelligence raters. Neural networks for rating pictorial expression
Autor(a) principal: | |
---|---|
Data de Publicação: | 2022 |
Outros Autores: | |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | https://doi.org/10.34632/jsta.2022.10196 |
Resumo: | Previous studies on classification of fine art show that features of paintings can be captured and categorized using machine learning approaches. This progress can also benefit art psychology by facilitating data collection on artworks without the need to recruit experts as raters. In this study a machine learning approach is used to predict the ratings of RizbA, a Rating instrument for two-dimensional pictorial works. Based on a pre-trained model, the algorithm was fine-tuned via transfer learning on 886 pictorial works by contemporary professional artists and non-professionals. As quality criterion, artificial intelligence raters (ART) are compared with generic raters (GR) created from the real human expert raters, using error rate and mean squared error (MSE). ART ratings have been found to have the same error range as randomly chosen human ratings. Therefore, they can be seen as equivalent to real human expert raters for almost all items in RizbA. Further training with more data will close the gap to the human raters on all items. |
id |
RCAP_e749ee9cfc92f0dea39b61f604405b4b |
---|---|
oai_identifier_str |
oai:ojs.revistas.ucp.pt:article/10196 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
ARTificial intelligence raters. Neural networks for rating pictorial expressionPrevious studies on classification of fine art show that features of paintings can be captured and categorized using machine learning approaches. This progress can also benefit art psychology by facilitating data collection on artworks without the need to recruit experts as raters. In this study a machine learning approach is used to predict the ratings of RizbA, a Rating instrument for two-dimensional pictorial works. Based on a pre-trained model, the algorithm was fine-tuned via transfer learning on 886 pictorial works by contemporary professional artists and non-professionals. As quality criterion, artificial intelligence raters (ART) are compared with generic raters (GR) created from the real human expert raters, using error rate and mean squared error (MSE). ART ratings have been found to have the same error range as randomly chosen human ratings. Therefore, they can be seen as equivalent to real human expert raters for almost all items in RizbA. Further training with more data will close the gap to the human raters on all items.Universidade Católica Portuguesa2022-04-30T00:00:00Zjournal articleinfo:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdfhttps://doi.org/10.34632/jsta.2022.10196oai:ojs.revistas.ucp.pt:article/10196Journal of Science and Technology of the Arts; Vol 14 No 1 (2022); 49-71Journal of Science and Technology of the Arts; v. 14 n. 1 (2022); 49-712183-00881646-979810.34632/jsta.2022.14.1reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAPenghttps://revistas.ucp.pt/index.php/jsta/article/view/10196https://doi.org/10.34632/jsta.2022.10196https://revistas.ucp.pt/index.php/jsta/article/view/10196/11141Copyright (c) 2022 Thomas Gengenbach, Kerstin Schochhttp://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessGengenbach, ThomasSchoch, Kerstin2022-09-22T16:19:30Zoai:ojs.revistas.ucp.pt:article/10196Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T15:59:08.127277Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
ARTificial intelligence raters. Neural networks for rating pictorial expression |
title |
ARTificial intelligence raters. Neural networks for rating pictorial expression |
spellingShingle |
ARTificial intelligence raters. Neural networks for rating pictorial expression Gengenbach, Thomas |
title_short |
ARTificial intelligence raters. Neural networks for rating pictorial expression |
title_full |
ARTificial intelligence raters. Neural networks for rating pictorial expression |
title_fullStr |
ARTificial intelligence raters. Neural networks for rating pictorial expression |
title_full_unstemmed |
ARTificial intelligence raters. Neural networks for rating pictorial expression |
title_sort |
ARTificial intelligence raters. Neural networks for rating pictorial expression |
author |
Gengenbach, Thomas |
author_facet |
Gengenbach, Thomas Schoch, Kerstin |
author_role |
author |
author2 |
Schoch, Kerstin |
author2_role |
author |
dc.contributor.author.fl_str_mv |
Gengenbach, Thomas Schoch, Kerstin |
description |
Previous studies on classification of fine art show that features of paintings can be captured and categorized using machine learning approaches. This progress can also benefit art psychology by facilitating data collection on artworks without the need to recruit experts as raters. In this study a machine learning approach is used to predict the ratings of RizbA, a Rating instrument for two-dimensional pictorial works. Based on a pre-trained model, the algorithm was fine-tuned via transfer learning on 886 pictorial works by contemporary professional artists and non-professionals. As quality criterion, artificial intelligence raters (ART) are compared with generic raters (GR) created from the real human expert raters, using error rate and mean squared error (MSE). ART ratings have been found to have the same error range as randomly chosen human ratings. Therefore, they can be seen as equivalent to real human expert raters for almost all items in RizbA. Further training with more data will close the gap to the human raters on all items. |
publishDate |
2022 |
dc.date.none.fl_str_mv |
2022-04-30T00:00:00Z |
dc.type.driver.fl_str_mv |
journal article info:eu-repo/semantics/article |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://doi.org/10.34632/jsta.2022.10196 oai:ojs.revistas.ucp.pt:article/10196 |
url |
https://doi.org/10.34632/jsta.2022.10196 |
identifier_str_mv |
oai:ojs.revistas.ucp.pt:article/10196 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
https://revistas.ucp.pt/index.php/jsta/article/view/10196 https://doi.org/10.34632/jsta.2022.10196 https://revistas.ucp.pt/index.php/jsta/article/view/10196/11141 |
dc.rights.driver.fl_str_mv |
Copyright (c) 2022 Thomas Gengenbach, Kerstin Schoch http://creativecommons.org/licenses/by/4.0 info:eu-repo/semantics/openAccess |
rights_invalid_str_mv |
Copyright (c) 2022 Thomas Gengenbach, Kerstin Schoch http://creativecommons.org/licenses/by/4.0 |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Universidade Católica Portuguesa |
publisher.none.fl_str_mv |
Universidade Católica Portuguesa |
dc.source.none.fl_str_mv |
Journal of Science and Technology of the Arts; Vol 14 No 1 (2022); 49-71 Journal of Science and Technology of the Arts; v. 14 n. 1 (2022); 49-71 2183-0088 1646-9798 10.34632/jsta.2022.14.1 reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799130458144899072 |