“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI
Autor(a) principal: | |
---|---|
Data de Publicação: | 2024 |
Outros Autores: | , , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | http://hdl.handle.net/10071/30733 |
Resumo: | Although they often have a negative connotation due to their social risks, deepfakes have the potential to improve HCI, human-centered AI, and user experience (UX). To investigate the impact of deepfakes on persona UX, we conducted an experimental study with 46 users who used a deepfake persona and a human persona to carry out a design task. We collected think-aloud, observant notes, and survey data. The results of our mixed-method analysis indicate that if users observe glitches in the deepfake personas, these glitches have a detrimental effect on the persona UX and task performance; however, not all users identify glitches. Our quantitative analysis of survey data shows that there are differences in how (a) users perceive deepfakes, (b) users detect deepfake glitches, (c) deepfake glitches affect information comprehension, and (d) deepfake glitches affect task completion. Glitches have the most significant impact on authenticity, persona perception, and task perception variables but less impact on behavioral variables. The results imply that organizations implementing deepfake personas need to address perceptual challenges before the full potential of deepfake technology can be realized for persona creation. |
id |
RCAP_5efa8cd58432aeed4be4a8eec1961399 |
---|---|
oai_identifier_str |
oai:repositorio.iscte-iul.pt:10071/30733 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AIDeepfakesUser perceptionsHuman-centered AIUser studyAlthough they often have a negative connotation due to their social risks, deepfakes have the potential to improve HCI, human-centered AI, and user experience (UX). To investigate the impact of deepfakes on persona UX, we conducted an experimental study with 46 users who used a deepfake persona and a human persona to carry out a design task. We collected think-aloud, observant notes, and survey data. The results of our mixed-method analysis indicate that if users observe glitches in the deepfake personas, these glitches have a detrimental effect on the persona UX and task performance; however, not all users identify glitches. Our quantitative analysis of survey data shows that there are differences in how (a) users perceive deepfakes, (b) users detect deepfake glitches, (c) deepfake glitches affect information comprehension, and (d) deepfake glitches affect task completion. Glitches have the most significant impact on authenticity, persona perception, and task perception variables but less impact on behavioral variables. The results imply that organizations implementing deepfake personas need to address perceptual challenges before the full potential of deepfake technology can be realized for persona creation.Elsevier2024-01-31T13:53:19Z2024-01-01T00:00:00Z20242024-01-31T13:51:54Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10071/30733eng2949-882110.1016/j.chbah.2023.100031Kaate, I.Salminen, J.Santos, J. M.Jung, S.-G.Almerekhi, H. A.Jansen, B. J.info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-02-04T01:22:13Zoai:repositorio.iscte-iul.pt:10071/30733Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T02:08:09.478266Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI |
title |
“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI |
spellingShingle |
“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI Kaate, I. Deepfakes User perceptions Human-centered AI User study |
title_short |
“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI |
title_full |
“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI |
title_fullStr |
“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI |
title_full_unstemmed |
“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI |
title_sort |
“There is something Rotten in Denmark”: Investigating the deepfake persona perceptions and their implications for human-centered AI |
author |
Kaate, I. |
author_facet |
Kaate, I. Salminen, J. Santos, J. M. Jung, S.-G. Almerekhi, H. A. Jansen, B. J. |
author_role |
author |
author2 |
Salminen, J. Santos, J. M. Jung, S.-G. Almerekhi, H. A. Jansen, B. J. |
author2_role |
author author author author author |
dc.contributor.author.fl_str_mv |
Kaate, I. Salminen, J. Santos, J. M. Jung, S.-G. Almerekhi, H. A. Jansen, B. J. |
dc.subject.por.fl_str_mv |
Deepfakes User perceptions Human-centered AI User study |
topic |
Deepfakes User perceptions Human-centered AI User study |
description |
Although they often have a negative connotation due to their social risks, deepfakes have the potential to improve HCI, human-centered AI, and user experience (UX). To investigate the impact of deepfakes on persona UX, we conducted an experimental study with 46 users who used a deepfake persona and a human persona to carry out a design task. We collected think-aloud, observant notes, and survey data. The results of our mixed-method analysis indicate that if users observe glitches in the deepfake personas, these glitches have a detrimental effect on the persona UX and task performance; however, not all users identify glitches. Our quantitative analysis of survey data shows that there are differences in how (a) users perceive deepfakes, (b) users detect deepfake glitches, (c) deepfake glitches affect information comprehension, and (d) deepfake glitches affect task completion. Glitches have the most significant impact on authenticity, persona perception, and task perception variables but less impact on behavioral variables. The results imply that organizations implementing deepfake personas need to address perceptual challenges before the full potential of deepfake technology can be realized for persona creation. |
publishDate |
2024 |
dc.date.none.fl_str_mv |
2024-01-31T13:53:19Z 2024-01-01T00:00:00Z 2024 2024-01-31T13:51:54Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://hdl.handle.net/10071/30733 |
url |
http://hdl.handle.net/10071/30733 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
2949-8821 10.1016/j.chbah.2023.100031 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Elsevier |
publisher.none.fl_str_mv |
Elsevier |
dc.source.none.fl_str_mv |
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799137170254987264 |