One Recommender Fits All? An Exploration of User Satisfaction With Text-Based News Recommender Systems

Detalhes bibliográficos
Autor(a) principal: Wieland, Mareike
Data de Publicação: 2021
Outros Autores: Nordheim, Gerret von, Kleinen-von Königslöw, Katharina
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: https://doi.org/10.17645/mac.v9i4.4241
Resumo: Journalistic media increasingly address changing user behaviour online by implementing algorithmic recommendations on their pages. While social media extensively rely on user data for personalized recommendations, journalistic media may choose to aim to improve the user experience based on textual features such as thematic similarity. From a societal viewpoint, these recommendations should be as diverse as possible. Users, however, tend to prefer recommendations that enable “serendipity”—the perception of an item as a welcome surprise that strikes just the right balance between more similarly useful but still novel content. By conducting a representative online survey with n = 588 respondents, we investigate how users evaluate algorithmic news recommendations (recommendation satisfaction, as well as perceived novelty and unexpectedness) based on different similarity settings and how individual dispositions (news interest, civic information norm, need for cognitive closure, etc.) may affect these evaluations. The core piece of our survey is a self-programmed recommendation system that accesses a database of vectorized news articles. Respondents search for a personally relevant keyword and select a suitable article, after which another article is recommended automatically, at random, using one of three similarity settings. Our findings show that users prefer recommendations of the most similar articles, which are at the same time perceived as novel, but not necessarily unexpected. However, user evaluations will differ depending on personal characteristics such as formal education, the civic information norm, and the need for cognitive closure.
id RCAP_bc67202ef979fae96de8275013d7c418
oai_identifier_str oai:ojs.cogitatiopress.com:article/4241
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling One Recommender Fits All? An Exploration of User Satisfaction With Text-Based News Recommender Systemsalgorithm-based recommenders; diversity; news recommender design; recommender field experiment; reliable surpriseJournalistic media increasingly address changing user behaviour online by implementing algorithmic recommendations on their pages. While social media extensively rely on user data for personalized recommendations, journalistic media may choose to aim to improve the user experience based on textual features such as thematic similarity. From a societal viewpoint, these recommendations should be as diverse as possible. Users, however, tend to prefer recommendations that enable “serendipity”—the perception of an item as a welcome surprise that strikes just the right balance between more similarly useful but still novel content. By conducting a representative online survey with n = 588 respondents, we investigate how users evaluate algorithmic news recommendations (recommendation satisfaction, as well as perceived novelty and unexpectedness) based on different similarity settings and how individual dispositions (news interest, civic information norm, need for cognitive closure, etc.) may affect these evaluations. The core piece of our survey is a self-programmed recommendation system that accesses a database of vectorized news articles. Respondents search for a personally relevant keyword and select a suitable article, after which another article is recommended automatically, at random, using one of three similarity settings. Our findings show that users prefer recommendations of the most similar articles, which are at the same time perceived as novel, but not necessarily unexpected. However, user evaluations will differ depending on personal characteristics such as formal education, the civic information norm, and the need for cognitive closure.Cogitatio2021-11-18info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttps://doi.org/10.17645/mac.v9i4.4241oai:ojs.cogitatiopress.com:article/4241Media and Communication; Vol 9, No 4 (2021): Algorithmic Systems in the Digital Society; 208-2212183-2439reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAPenghttps://www.cogitatiopress.com/mediaandcommunication/article/view/4241https://doi.org/10.17645/mac.v9i4.4241https://www.cogitatiopress.com/mediaandcommunication/article/view/4241/4241Copyright (c) 2021 Mareike Wieland, Gerret von Nordheim, Katharina Kleinen-von Königslöwhttp://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessWieland, MareikeNordheim, Gerret vonKleinen-von Königslöw, Katharina2022-12-20T10:57:50Zoai:ojs.cogitatiopress.com:article/4241Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T16:20:33.050261Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv One Recommender Fits All? An Exploration of User Satisfaction With Text-Based News Recommender Systems
title One Recommender Fits All? An Exploration of User Satisfaction With Text-Based News Recommender Systems
spellingShingle One Recommender Fits All? An Exploration of User Satisfaction With Text-Based News Recommender Systems
Wieland, Mareike
algorithm-based recommenders; diversity; news recommender design; recommender field experiment; reliable surprise
title_short One Recommender Fits All? An Exploration of User Satisfaction With Text-Based News Recommender Systems
title_full One Recommender Fits All? An Exploration of User Satisfaction With Text-Based News Recommender Systems
title_fullStr One Recommender Fits All? An Exploration of User Satisfaction With Text-Based News Recommender Systems
title_full_unstemmed One Recommender Fits All? An Exploration of User Satisfaction With Text-Based News Recommender Systems
title_sort One Recommender Fits All? An Exploration of User Satisfaction With Text-Based News Recommender Systems
author Wieland, Mareike
author_facet Wieland, Mareike
Nordheim, Gerret von
Kleinen-von Königslöw, Katharina
author_role author
author2 Nordheim, Gerret von
Kleinen-von Königslöw, Katharina
author2_role author
author
dc.contributor.author.fl_str_mv Wieland, Mareike
Nordheim, Gerret von
Kleinen-von Königslöw, Katharina
dc.subject.por.fl_str_mv algorithm-based recommenders; diversity; news recommender design; recommender field experiment; reliable surprise
topic algorithm-based recommenders; diversity; news recommender design; recommender field experiment; reliable surprise
description Journalistic media increasingly address changing user behaviour online by implementing algorithmic recommendations on their pages. While social media extensively rely on user data for personalized recommendations, journalistic media may choose to aim to improve the user experience based on textual features such as thematic similarity. From a societal viewpoint, these recommendations should be as diverse as possible. Users, however, tend to prefer recommendations that enable “serendipity”—the perception of an item as a welcome surprise that strikes just the right balance between more similarly useful but still novel content. By conducting a representative online survey with n = 588 respondents, we investigate how users evaluate algorithmic news recommendations (recommendation satisfaction, as well as perceived novelty and unexpectedness) based on different similarity settings and how individual dispositions (news interest, civic information norm, need for cognitive closure, etc.) may affect these evaluations. The core piece of our survey is a self-programmed recommendation system that accesses a database of vectorized news articles. Respondents search for a personally relevant keyword and select a suitable article, after which another article is recommended automatically, at random, using one of three similarity settings. Our findings show that users prefer recommendations of the most similar articles, which are at the same time perceived as novel, but not necessarily unexpected. However, user evaluations will differ depending on personal characteristics such as formal education, the civic information norm, and the need for cognitive closure.
publishDate 2021
dc.date.none.fl_str_mv 2021-11-18
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://doi.org/10.17645/mac.v9i4.4241
oai:ojs.cogitatiopress.com:article/4241
url https://doi.org/10.17645/mac.v9i4.4241
identifier_str_mv oai:ojs.cogitatiopress.com:article/4241
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv https://www.cogitatiopress.com/mediaandcommunication/article/view/4241
https://doi.org/10.17645/mac.v9i4.4241
https://www.cogitatiopress.com/mediaandcommunication/article/view/4241/4241
dc.rights.driver.fl_str_mv Copyright (c) 2021 Mareike Wieland, Gerret von Nordheim, Katharina Kleinen-von Königslöw
http://creativecommons.org/licenses/by/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Copyright (c) 2021 Mareike Wieland, Gerret von Nordheim, Katharina Kleinen-von Königslöw
http://creativecommons.org/licenses/by/4.0
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Cogitatio
publisher.none.fl_str_mv Cogitatio
dc.source.none.fl_str_mv Media and Communication; Vol 9, No 4 (2021): Algorithmic Systems in the Digital Society; 208-221
2183-2439
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799130653507190784