Explicit knowledge of task structure is a primary determinant of human model-based action

Detalhes bibliográficos
Autor(a) principal: Castro-Rodrigues, Pedro
Data de Publicação: 2022
Outros Autores: Akam, Thomas, Snorasson, Ivar, Camacho, Marta, Paixão, Vitor, Maia, Ana, Barahona-Corrêa, J. Bernardo, Dayan, Peter, Simpson, H. Blair, Costa, Rui M., Oliveira-Maia, Albino J.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10400.26/41275
Resumo: Explicit information obtained through instruction profoundly shapes human choice behaviour. However, this has been studied in computationally simple tasks, and it is unknown how model-based and model-free systems, respectively generating goal-directed and habitual actions, are affected by the absence or presence of instructions. We assessed behaviour in a variant of a computationally more complex decision-making task, before and after providing information about task structure, both in healthy volunteers and in individuals suffering from obsessive-compulsive or other disorders. Initial behaviour was model-free, with rewards directly reinforcing preceding actions. Model-based control, employing predictions of states resulting from each action, emerged with experience in a minority of participants, and less in those with obsessive-compulsive disorder. Providing task structure information strongly increased model-based control, similarly across all groups. Thus, in humans, explicit task structural knowledge is a primary determinant of model-based reinforcement learning and is most readily acquired from instruction rather than experience.
id RCAP_ca6f30e17139ea1e6123194fd0309629
oai_identifier_str oai:comum.rcaap.pt:10400.26/41275
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Explicit knowledge of task structure is a primary determinant of human model-based actionExplicit information obtained through instruction profoundly shapes human choice behaviour. However, this has been studied in computationally simple tasks, and it is unknown how model-based and model-free systems, respectively generating goal-directed and habitual actions, are affected by the absence or presence of instructions. We assessed behaviour in a variant of a computationally more complex decision-making task, before and after providing information about task structure, both in healthy volunteers and in individuals suffering from obsessive-compulsive or other disorders. Initial behaviour was model-free, with rewards directly reinforcing preceding actions. Model-based control, employing predictions of states resulting from each action, emerged with experience in a minority of participants, and less in those with obsessive-compulsive disorder. Providing task structure information strongly increased model-based control, similarly across all groups. Thus, in humans, explicit task structural knowledge is a primary determinant of model-based reinforcement learning and is most readily acquired from instruction rather than experience.Repositório ComumCastro-Rodrigues, PedroAkam, ThomasSnorasson, IvarCamacho, MartaPaixão, VitorMaia, AnaBarahona-Corrêa, J. BernardoDayan, PeterSimpson, H. BlairCosta, Rui M.Oliveira-Maia, Albino J.2022-07-05T09:48:55Z2022-052022-05-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10400.26/41275engCastro-Rodrigues, P., Akam, T., Snorasson, I., Camacho, M., Paixão, V., Maia, A., Barahona-Corrêa, J. B., Dayan, P., Simpson, H. B., Costa, R. M., & Oliveira-Maia, A. J. (2022). Explicit knowledge of task structure is a primary determinant of human model-based action. Nature human behaviour, 10.1038/s41562-022-01346-2. Advance online publication. https://doi.org/10.1038/s41562-022-01346-210.1038/s41562-022-01346-2info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-05-17T17:15:26Zoai:comum.rcaap.pt:10400.26/41275Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T15:49:01.873307Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Explicit knowledge of task structure is a primary determinant of human model-based action
title Explicit knowledge of task structure is a primary determinant of human model-based action
spellingShingle Explicit knowledge of task structure is a primary determinant of human model-based action
Castro-Rodrigues, Pedro
title_short Explicit knowledge of task structure is a primary determinant of human model-based action
title_full Explicit knowledge of task structure is a primary determinant of human model-based action
title_fullStr Explicit knowledge of task structure is a primary determinant of human model-based action
title_full_unstemmed Explicit knowledge of task structure is a primary determinant of human model-based action
title_sort Explicit knowledge of task structure is a primary determinant of human model-based action
author Castro-Rodrigues, Pedro
author_facet Castro-Rodrigues, Pedro
Akam, Thomas
Snorasson, Ivar
Camacho, Marta
Paixão, Vitor
Maia, Ana
Barahona-Corrêa, J. Bernardo
Dayan, Peter
Simpson, H. Blair
Costa, Rui M.
Oliveira-Maia, Albino J.
author_role author
author2 Akam, Thomas
Snorasson, Ivar
Camacho, Marta
Paixão, Vitor
Maia, Ana
Barahona-Corrêa, J. Bernardo
Dayan, Peter
Simpson, H. Blair
Costa, Rui M.
Oliveira-Maia, Albino J.
author2_role author
author
author
author
author
author
author
author
author
author
dc.contributor.none.fl_str_mv Repositório Comum
dc.contributor.author.fl_str_mv Castro-Rodrigues, Pedro
Akam, Thomas
Snorasson, Ivar
Camacho, Marta
Paixão, Vitor
Maia, Ana
Barahona-Corrêa, J. Bernardo
Dayan, Peter
Simpson, H. Blair
Costa, Rui M.
Oliveira-Maia, Albino J.
description Explicit information obtained through instruction profoundly shapes human choice behaviour. However, this has been studied in computationally simple tasks, and it is unknown how model-based and model-free systems, respectively generating goal-directed and habitual actions, are affected by the absence or presence of instructions. We assessed behaviour in a variant of a computationally more complex decision-making task, before and after providing information about task structure, both in healthy volunteers and in individuals suffering from obsessive-compulsive or other disorders. Initial behaviour was model-free, with rewards directly reinforcing preceding actions. Model-based control, employing predictions of states resulting from each action, emerged with experience in a minority of participants, and less in those with obsessive-compulsive disorder. Providing task structure information strongly increased model-based control, similarly across all groups. Thus, in humans, explicit task structural knowledge is a primary determinant of model-based reinforcement learning and is most readily acquired from instruction rather than experience.
publishDate 2022
dc.date.none.fl_str_mv 2022-07-05T09:48:55Z
2022-05
2022-05-01T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10400.26/41275
url http://hdl.handle.net/10400.26/41275
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Castro-Rodrigues, P., Akam, T., Snorasson, I., Camacho, M., Paixão, V., Maia, A., Barahona-Corrêa, J. B., Dayan, P., Simpson, H. B., Costa, R. M., & Oliveira-Maia, A. J. (2022). Explicit knowledge of task structure is a primary determinant of human model-based action. Nature human behaviour, 10.1038/s41562-022-01346-2. Advance online publication. https://doi.org/10.1038/s41562-022-01346-2
10.1038/s41562-022-01346-2
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799130356341800960