“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI

Detalhes bibliográficos
Autor(a) principal: Kaate, I.
Data de Publicação: 2024
Outros Autores: Salminen, J., Santos, J. M., Jung, S.-G., Almerekhi, H. A., Jansen, B. J.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10071/30733
Resumo: Although they often have a negative connotation due to their social risks, deepfakes have the potential to improve HCI, human-centered AI, and user experience (UX). To investigate the impact of deepfakes on persona UX, we conducted an experimental study with 46 users who used a deepfake persona and a human persona to carry out a design task. We collected think-aloud, observant notes, and survey data. The results of our mixed-method analysis indicate that if users observe glitches in the deepfake personas, these glitches have a detrimental effect on the persona UX and task performance; however, not all users identify glitches. Our quantitative analysis of survey data shows that there are differences in how (a) users perceive deepfakes, (b) users detect deepfake glitches, (c) deepfake glitches affect information comprehension, and (d) deepfake glitches affect task completion. Glitches have the most significant impact on authenticity, persona perception, and task perception variables but less impact on behavioral variables. The results imply that organizations implementing deepfake personas need to address perceptual challenges before the full potential of deepfake technology can be realized for persona creation.
id RCAP_5efa8cd58432aeed4be4a8eec1961399
oai_identifier_str oai:repositorio.iscte-iul.pt:10071/30733
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling “There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AIDeepfakesUser perceptionsHuman-centered AIUser studyAlthough they often have a negative connotation due to their social risks, deepfakes have the potential to improve HCI, human-centered AI, and user experience (UX). To investigate the impact of deepfakes on persona UX, we conducted an experimental study with 46 users who used a deepfake persona and a human persona to carry out a design task. We collected think-aloud, observant notes, and survey data. The results of our mixed-method analysis indicate that if users observe glitches in the deepfake personas, these glitches have a detrimental effect on the persona UX and task performance; however, not all users identify glitches. Our quantitative analysis of survey data shows that there are differences in how (a) users perceive deepfakes, (b) users detect deepfake glitches, (c) deepfake glitches affect information comprehension, and (d) deepfake glitches affect task completion. Glitches have the most significant impact on authenticity, persona perception, and task perception variables but less impact on behavioral variables. The results imply that organizations implementing deepfake personas need to address perceptual challenges before the full potential of deepfake technology can be realized for persona creation.Elsevier2024-01-31T13:53:19Z2024-01-01T00:00:00Z20242024-01-31T13:51:54Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10071/30733eng2949-882110.1016/j.chbah.2023.100031Kaate, I.Salminen, J.Santos, J. M.Jung, S.-G.Almerekhi, H. A.Jansen, B. J.info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-02-04T01:22:13Zoai:repositorio.iscte-iul.pt:10071/30733Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T02:08:09.478266Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv “There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI
title “There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI
spellingShingle “There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI
Kaate, I.
Deepfakes
User perceptions
Human-centered AI
User study
title_short “There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI
title_full “There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI
title_fullStr “There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI
title_full_unstemmed “There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI
title_sort “There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI
author Kaate, I.
author_facet Kaate, I.
Salminen, J.
Santos, J. M.
Jung, S.-G.
Almerekhi, H. A.
Jansen, B. J.
author_role author
author2 Salminen, J.
Santos, J. M.
Jung, S.-G.
Almerekhi, H. A.
Jansen, B. J.
author2_role author
author
author
author
author
dc.contributor.author.fl_str_mv Kaate, I.
Salminen, J.
Santos, J. M.
Jung, S.-G.
Almerekhi, H. A.
Jansen, B. J.
dc.subject.por.fl_str_mv Deepfakes
User perceptions
Human-centered AI
User study
topic Deepfakes
User perceptions
Human-centered AI
User study
description Although they often have a negative connotation due to their social risks, deepfakes have the potential to improve HCI, human-centered AI, and user experience (UX). To investigate the impact of deepfakes on persona UX, we conducted an experimental study with 46 users who used a deepfake persona and a human persona to carry out a design task. We collected think-aloud, observant notes, and survey data. The results of our mixed-method analysis indicate that if users observe glitches in the deepfake personas, these glitches have a detrimental effect on the persona UX and task performance; however, not all users identify glitches. Our quantitative analysis of survey data shows that there are differences in how (a) users perceive deepfakes, (b) users detect deepfake glitches, (c) deepfake glitches affect information comprehension, and (d) deepfake glitches affect task completion. Glitches have the most significant impact on authenticity, persona perception, and task perception variables but less impact on behavioral variables. The results imply that organizations implementing deepfake personas need to address perceptual challenges before the full potential of deepfake technology can be realized for persona creation.
publishDate 2024
dc.date.none.fl_str_mv 2024-01-31T13:53:19Z
2024-01-01T00:00:00Z
2024
2024-01-31T13:51:54Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10071/30733
url http://hdl.handle.net/10071/30733
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 2949-8821
10.1016/j.chbah.2023.100031
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Elsevier
publisher.none.fl_str_mv Elsevier
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799137170254987264