Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument

Detalhes bibliográficos
Autor(a) principal: Pinto, Joana O.
Data de Publicação: 2023
Outros Autores: Dores, Artemisa Rocha, Peixoto, Bruno, Barbosa, Fernando
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10400.22/22229
Resumo: The main objectives of this study are to identify the dimensions of Ecological Validity(EV) within the definitions of this concept, understand how they are operationalized in neurocog-nitive tests, and propose a checklist for EV attributes in neurocognitive tests. A systematized review was combined with content analysis of the selected papers, usingthe inductive method. We analyzed 82 studies on the EV of neurocognitive tests, 19 literaturereviews and 63 empirical studies. Based on this review, we identified the relevant criteria for evalu-ating EV. EV is a multidimensional concept with two main dimensions: representativeness and gen-eralization. Representativeness involves the subdimensions simplicity-complexity and artificial-nat-ural and several criteria organized on a continuum from low EV to high EV. Generalization isdependent on representativeness and is influenced by different cognitive and non-cognitive fac-tors. We propose six stages for operationalizing EV, from defining the objectives of the neurocog-nitive assessment to the methodology for scoring and interpreting the results.This systematized review helps to operationalize the concept of EV by providing atool for evaluating and improving EV while developing new tests. Further studies with a longitu-dinal design can compare the predictive value of tests with higher versus lower EV-checklistscores.
id RCAP_717c94e0dca7d69865b51f84390b7e9c
oai_identifier_str oai:recipp.ipp.pt:10400.22/22229
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrumentChecklistContent analysisEcological validityNeurocognitive assessmentSystematized reviewThe main objectives of this study are to identify the dimensions of Ecological Validity(EV) within the definitions of this concept, understand how they are operationalized in neurocog-nitive tests, and propose a checklist for EV attributes in neurocognitive tests. A systematized review was combined with content analysis of the selected papers, usingthe inductive method. We analyzed 82 studies on the EV of neurocognitive tests, 19 literaturereviews and 63 empirical studies. Based on this review, we identified the relevant criteria for evalu-ating EV. EV is a multidimensional concept with two main dimensions: representativeness and gen-eralization. Representativeness involves the subdimensions simplicity-complexity and artificial-nat-ural and several criteria organized on a continuum from low EV to high EV. Generalization isdependent on representativeness and is influenced by different cognitive and non-cognitive fac-tors. We propose six stages for operationalizing EV, from defining the objectives of the neurocog-nitive assessment to the methodology for scoring and interpreting the results.This systematized review helps to operationalize the concept of EV by providing atool for evaluating and improving EV while developing new tests. Further studies with a longitu-dinal design can compare the predictive value of tests with higher versus lower EV-checklistscores.Taylor&Francis OnlineRepositório Científico do Instituto Politécnico do PortoPinto, Joana O.Dores, Artemisa RochaPeixoto, BrunoBarbosa, Fernando2023-02-10T10:32:10Z2023-02-082023-02-08T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10400.22/22229engPinto, J. O., Dores, A. R., Peixoto, B., & Barbosa, F. (2023). Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument. Applied Neuropsychology: Adult, 1–18. https://doi.org/10.1080/23279095.2023.21708002327-909510.1080/23279095.2023.21708002327-9109metadata only accessinfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-01-03T01:48:05Zoai:recipp.ipp.pt:10400.22/22229Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T17:42:17.276783Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument
title Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument
spellingShingle Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument
Pinto, Joana O.
Checklist
Content analysis
Ecological validity
Neurocognitive assessment
Systematized review
title_short Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument
title_full Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument
title_fullStr Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument
title_full_unstemmed Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument
title_sort Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument
author Pinto, Joana O.
author_facet Pinto, Joana O.
Dores, Artemisa Rocha
Peixoto, Bruno
Barbosa, Fernando
author_role author
author2 Dores, Artemisa Rocha
Peixoto, Bruno
Barbosa, Fernando
author2_role author
author
author
dc.contributor.none.fl_str_mv Repositório Científico do Instituto Politécnico do Porto
dc.contributor.author.fl_str_mv Pinto, Joana O.
Dores, Artemisa Rocha
Peixoto, Bruno
Barbosa, Fernando
dc.subject.por.fl_str_mv Checklist
Content analysis
Ecological validity
Neurocognitive assessment
Systematized review
topic Checklist
Content analysis
Ecological validity
Neurocognitive assessment
Systematized review
description The main objectives of this study are to identify the dimensions of Ecological Validity(EV) within the definitions of this concept, understand how they are operationalized in neurocog-nitive tests, and propose a checklist for EV attributes in neurocognitive tests. A systematized review was combined with content analysis of the selected papers, usingthe inductive method. We analyzed 82 studies on the EV of neurocognitive tests, 19 literaturereviews and 63 empirical studies. Based on this review, we identified the relevant criteria for evalu-ating EV. EV is a multidimensional concept with two main dimensions: representativeness and gen-eralization. Representativeness involves the subdimensions simplicity-complexity and artificial-nat-ural and several criteria organized on a continuum from low EV to high EV. Generalization isdependent on representativeness and is influenced by different cognitive and non-cognitive fac-tors. We propose six stages for operationalizing EV, from defining the objectives of the neurocog-nitive assessment to the methodology for scoring and interpreting the results.This systematized review helps to operationalize the concept of EV by providing atool for evaluating and improving EV while developing new tests. Further studies with a longitu-dinal design can compare the predictive value of tests with higher versus lower EV-checklistscores.
publishDate 2023
dc.date.none.fl_str_mv 2023-02-10T10:32:10Z
2023-02-08
2023-02-08T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10400.22/22229
url http://hdl.handle.net/10400.22/22229
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Pinto, J. O., Dores, A. R., Peixoto, B., & Barbosa, F. (2023). Ecological validity in neurocognitive assessment: Systematized review, content analysis, and proposal of an instrument. Applied Neuropsychology: Adult, 1–18. https://doi.org/10.1080/23279095.2023.2170800
2327-9095
10.1080/23279095.2023.2170800
2327-9109
dc.rights.driver.fl_str_mv metadata only access
info:eu-repo/semantics/openAccess
rights_invalid_str_mv metadata only access
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Taylor&Francis Online
publisher.none.fl_str_mv Taylor&Francis Online
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1817552952401854464