Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information

Detalhes bibliográficos
Autor(a) principal: Bergström, Fredrik
Data de Publicação: 2021
Outros Autores: Wurm, Moritz, Valério, Daniela Filipa Codinha, Lingnau, Angelika, Almeida, Jorge
Tipo de documento: Artigo
Idioma: por
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10316/95722
https://doi.org/10.1016/j.cortex.2021.03.004
Resumo: When we see a manipulable object (henceforth tool) or a hand performing a grasping movement, our brain is automatically tuned to how that tool can be grasped (i.e., its affordance) or what kind of grasp that hand is performing (e.g., a power or precision grasp). However, it remains unclear where visual information related to tools or hands are transformed into abstract grasp representations. We therefore investigated where different levels of abstractness in grasp information are processed: grasp information that is invariant to the kind of stimuli that elicits it (tool-hand invariance); and grasp information that is hand-specific but viewpoint-invariant (viewpoint invariance). We focused on brain areas activated when viewing both tools and hands, i.e., the posterior parietal cortices (PPC), ventral premotor cortices (PMv), and lateral occipitotemporal cortex/posterior middle temporal cortex (LOTC/pMTG). To test for invariant grasp representations, we presented participants with tool images and grasp videos (from first or third person perspective; 1pp or 3pp) inside an MRI scanner, and cross-decoded power versus precision grasps across (i) grasp perspectives (viewpoint invariance), (ii) tool images and grasp 1pp videos (tool-hand 1pp invariance), and (iii) tool images and grasp 3pp videos (tool-hand 3pp invariance). Tool-hand 1pp, but not tool-hand 3pp, invariant grasp information was found in left PPC, whereas viewpoint-invariant information was found bilaterally in PPC, left PMv, and left LOTC/pMTG. These findings suggest different levels of abstractness-where visual information is transformed into stimuli-invariant grasp representations/tool affordances in left PPC, and viewpoint invariant but hand-specific grasp representations in the hand network.
id RCAP_398ed31a53a7ea86cebd9682a2c53f8f
oai_identifier_str oai:estudogeral.uc.pt:10316/95722
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Decoding stimuli (tool-hand) and viewpoint invariant grasp-type informationHands; Parietal cortex; Prehension; Tools; fMRIHand StrengthHumansMagnetic Resonance ImagingParietal LobePsychomotor PerformanceBrain MappingHandWhen we see a manipulable object (henceforth tool) or a hand performing a grasping movement, our brain is automatically tuned to how that tool can be grasped (i.e., its affordance) or what kind of grasp that hand is performing (e.g., a power or precision grasp). However, it remains unclear where visual information related to tools or hands are transformed into abstract grasp representations. We therefore investigated where different levels of abstractness in grasp information are processed: grasp information that is invariant to the kind of stimuli that elicits it (tool-hand invariance); and grasp information that is hand-specific but viewpoint-invariant (viewpoint invariance). We focused on brain areas activated when viewing both tools and hands, i.e., the posterior parietal cortices (PPC), ventral premotor cortices (PMv), and lateral occipitotemporal cortex/posterior middle temporal cortex (LOTC/pMTG). To test for invariant grasp representations, we presented participants with tool images and grasp videos (from first or third person perspective; 1pp or 3pp) inside an MRI scanner, and cross-decoded power versus precision grasps across (i) grasp perspectives (viewpoint invariance), (ii) tool images and grasp 1pp videos (tool-hand 1pp invariance), and (iii) tool images and grasp 3pp videos (tool-hand 3pp invariance). Tool-hand 1pp, but not tool-hand 3pp, invariant grasp information was found in left PPC, whereas viewpoint-invariant information was found bilaterally in PPC, left PMv, and left LOTC/pMTG. These findings suggest different levels of abstractness-where visual information is transformed into stimuli-invariant grasp representations/tool affordances in left PPC, and viewpoint invariant but hand-specific grasp representations in the hand network.2021-03info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttp://hdl.handle.net/10316/95722http://hdl.handle.net/10316/95722https://doi.org/10.1016/j.cortex.2021.03.004por00109452Bergström, FredrikWurm, MoritzValério, Daniela Filipa CodinhaLingnau, AngelikaAlmeida, Jorgeinfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2022-05-25T03:29:15Zoai:estudogeral.uc.pt:10316/95722Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T21:14:08.524008Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
title Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
spellingShingle Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
Bergström, Fredrik
Hands; Parietal cortex; Prehension; Tools; fMRI
Hand Strength
Humans
Magnetic Resonance Imaging
Parietal Lobe
Psychomotor Performance
Brain Mapping
Hand
title_short Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
title_full Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
title_fullStr Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
title_full_unstemmed Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
title_sort Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information
author Bergström, Fredrik
author_facet Bergström, Fredrik
Wurm, Moritz
Valério, Daniela Filipa Codinha
Lingnau, Angelika
Almeida, Jorge
author_role author
author2 Wurm, Moritz
Valério, Daniela Filipa Codinha
Lingnau, Angelika
Almeida, Jorge
author2_role author
author
author
author
dc.contributor.author.fl_str_mv Bergström, Fredrik
Wurm, Moritz
Valério, Daniela Filipa Codinha
Lingnau, Angelika
Almeida, Jorge
dc.subject.por.fl_str_mv Hands; Parietal cortex; Prehension; Tools; fMRI
Hand Strength
Humans
Magnetic Resonance Imaging
Parietal Lobe
Psychomotor Performance
Brain Mapping
Hand
topic Hands; Parietal cortex; Prehension; Tools; fMRI
Hand Strength
Humans
Magnetic Resonance Imaging
Parietal Lobe
Psychomotor Performance
Brain Mapping
Hand
description When we see a manipulable object (henceforth tool) or a hand performing a grasping movement, our brain is automatically tuned to how that tool can be grasped (i.e., its affordance) or what kind of grasp that hand is performing (e.g., a power or precision grasp). However, it remains unclear where visual information related to tools or hands are transformed into abstract grasp representations. We therefore investigated where different levels of abstractness in grasp information are processed: grasp information that is invariant to the kind of stimuli that elicits it (tool-hand invariance); and grasp information that is hand-specific but viewpoint-invariant (viewpoint invariance). We focused on brain areas activated when viewing both tools and hands, i.e., the posterior parietal cortices (PPC), ventral premotor cortices (PMv), and lateral occipitotemporal cortex/posterior middle temporal cortex (LOTC/pMTG). To test for invariant grasp representations, we presented participants with tool images and grasp videos (from first or third person perspective; 1pp or 3pp) inside an MRI scanner, and cross-decoded power versus precision grasps across (i) grasp perspectives (viewpoint invariance), (ii) tool images and grasp 1pp videos (tool-hand 1pp invariance), and (iii) tool images and grasp 3pp videos (tool-hand 3pp invariance). Tool-hand 1pp, but not tool-hand 3pp, invariant grasp information was found in left PPC, whereas viewpoint-invariant information was found bilaterally in PPC, left PMv, and left LOTC/pMTG. These findings suggest different levels of abstractness-where visual information is transformed into stimuli-invariant grasp representations/tool affordances in left PPC, and viewpoint invariant but hand-specific grasp representations in the hand network.
publishDate 2021
dc.date.none.fl_str_mv 2021-03
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10316/95722
http://hdl.handle.net/10316/95722
https://doi.org/10.1016/j.cortex.2021.03.004
url http://hdl.handle.net/10316/95722
https://doi.org/10.1016/j.cortex.2021.03.004
dc.language.iso.fl_str_mv por
language por
dc.relation.none.fl_str_mv 00109452
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799134038624043008