A systematic review of validity procedures used in neuropsychological batteries

Detalhes bibliográficos
Autor(a) principal: Pawlowski,Josiane
Data de Publicação: 2013
Outros Autores: Segabinazi,Joice Dickel, Wagner,Flávia, Bandeira,Denise Ruschel
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Psychology & Neuroscience (Online)
Texto Completo: http://old.scielo.br/scielo.php?script=sci_arttext&pid=S1983-32882013000300009
Resumo: This study presents a systematic review of validity evidence for neuropsychological batteries. Studies published in international databases between 2005 and 2012 were examined. Considering the specificity of neuropsychological batteries, the aim of the study was to review the statistical analyses and procedures that have been used to validate these instruments. A total of 1,218 abstracts were read, of which 147 involved studies of neuropsychological batteries or tests that evaluated at least three cognitive processes. The full text of each article was analyzed according to publication year, focal instrument of the study, sample type, sample age range, characterization of the participants, and procedures and analyses used to provide evidence of validity. The results showed that the studies primarily analyzed patterns of convergence and divergence by correlating the instruments with other tests. Measures of reliability, such as internal consistency and test-retest reliability, were also frequently employed. To provide evidence of relationships between test scores and external criteria, the most common procedures were evaluations of sensitivity and specificity, and comparisons were made between contrasting groups. The statistical analyses frequently used were Receiver Operating Characteristic analysis, Pearson correlation, and Cronbach's alpha. We discuss the necessity of incorporating both classic and modern psychometric procedures and presenting a broader scope of validity evidence, which would represent progress in this field. Finally, we hope our findings will help researchers better plan the validation process for new neuropsychological instruments and batteries.
id PUCRJ-1_182449ffa2e050c3efbc139bcb0ac686
oai_identifier_str oai:scielo:S1983-32882013000300009
network_acronym_str PUCRJ-1
network_name_str Psychology & Neuroscience (Online)
repository_id_str
spelling A systematic review of validity procedures used in neuropsychological batteriesneuropsychological assessmentvalidityreliabilitysystematic reviewThis study presents a systematic review of validity evidence for neuropsychological batteries. Studies published in international databases between 2005 and 2012 were examined. Considering the specificity of neuropsychological batteries, the aim of the study was to review the statistical analyses and procedures that have been used to validate these instruments. A total of 1,218 abstracts were read, of which 147 involved studies of neuropsychological batteries or tests that evaluated at least three cognitive processes. The full text of each article was analyzed according to publication year, focal instrument of the study, sample type, sample age range, characterization of the participants, and procedures and analyses used to provide evidence of validity. The results showed that the studies primarily analyzed patterns of convergence and divergence by correlating the instruments with other tests. Measures of reliability, such as internal consistency and test-retest reliability, were also frequently employed. To provide evidence of relationships between test scores and external criteria, the most common procedures were evaluations of sensitivity and specificity, and comparisons were made between contrasting groups. The statistical analyses frequently used were Receiver Operating Characteristic analysis, Pearson correlation, and Cronbach's alpha. We discuss the necessity of incorporating both classic and modern psychometric procedures and presenting a broader scope of validity evidence, which would represent progress in this field. Finally, we hope our findings will help researchers better plan the validation process for new neuropsychological instruments and batteries.Pontificia Universidade Católica do Rio de JaneiroUniversidade de BrasíliaUniversidade de São Paulo2013-12-01info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersiontext/htmlhttp://old.scielo.br/scielo.php?script=sci_arttext&pid=S1983-32882013000300009Psychology & Neuroscience v.6 n.3 2013reponame:Psychology & Neuroscience (Online)instname:Instituto Brasileiro de Neuropsicologia e Comportamento (IBNeC)instacron:PUCRJ10.3922/j.psns.2013.3.09info:eu-repo/semantics/openAccessPawlowski,JosianeSegabinazi,Joice DickelWagner,FláviaBandeira,Denise Ruscheleng2014-02-28T00:00:00Zoai:scielo:S1983-32882013000300009Revistahttps://www.apa.org/pubs/journals/pnePRIhttps://old.scielo.br/oai/scielo-oai.phppsycneuro@psycneuro.org1983-32881984-3054opendoar:2014-02-28T00:00Psychology & Neuroscience (Online) - Instituto Brasileiro de Neuropsicologia e Comportamento (IBNeC)false
dc.title.none.fl_str_mv A systematic review of validity procedures used in neuropsychological batteries
title A systematic review of validity procedures used in neuropsychological batteries
spellingShingle A systematic review of validity procedures used in neuropsychological batteries
Pawlowski,Josiane
neuropsychological assessment
validity
reliability
systematic review
title_short A systematic review of validity procedures used in neuropsychological batteries
title_full A systematic review of validity procedures used in neuropsychological batteries
title_fullStr A systematic review of validity procedures used in neuropsychological batteries
title_full_unstemmed A systematic review of validity procedures used in neuropsychological batteries
title_sort A systematic review of validity procedures used in neuropsychological batteries
author Pawlowski,Josiane
author_facet Pawlowski,Josiane
Segabinazi,Joice Dickel
Wagner,Flávia
Bandeira,Denise Ruschel
author_role author
author2 Segabinazi,Joice Dickel
Wagner,Flávia
Bandeira,Denise Ruschel
author2_role author
author
author
dc.contributor.author.fl_str_mv Pawlowski,Josiane
Segabinazi,Joice Dickel
Wagner,Flávia
Bandeira,Denise Ruschel
dc.subject.por.fl_str_mv neuropsychological assessment
validity
reliability
systematic review
topic neuropsychological assessment
validity
reliability
systematic review
description This study presents a systematic review of validity evidence for neuropsychological batteries. Studies published in international databases between 2005 and 2012 were examined. Considering the specificity of neuropsychological batteries, the aim of the study was to review the statistical analyses and procedures that have been used to validate these instruments. A total of 1,218 abstracts were read, of which 147 involved studies of neuropsychological batteries or tests that evaluated at least three cognitive processes. The full text of each article was analyzed according to publication year, focal instrument of the study, sample type, sample age range, characterization of the participants, and procedures and analyses used to provide evidence of validity. The results showed that the studies primarily analyzed patterns of convergence and divergence by correlating the instruments with other tests. Measures of reliability, such as internal consistency and test-retest reliability, were also frequently employed. To provide evidence of relationships between test scores and external criteria, the most common procedures were evaluations of sensitivity and specificity, and comparisons were made between contrasting groups. The statistical analyses frequently used were Receiver Operating Characteristic analysis, Pearson correlation, and Cronbach's alpha. We discuss the necessity of incorporating both classic and modern psychometric procedures and presenting a broader scope of validity evidence, which would represent progress in this field. Finally, we hope our findings will help researchers better plan the validation process for new neuropsychological instruments and batteries.
publishDate 2013
dc.date.none.fl_str_mv 2013-12-01
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://old.scielo.br/scielo.php?script=sci_arttext&pid=S1983-32882013000300009
url http://old.scielo.br/scielo.php?script=sci_arttext&pid=S1983-32882013000300009
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 10.3922/j.psns.2013.3.09
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv text/html
dc.publisher.none.fl_str_mv Pontificia Universidade Católica do Rio de Janeiro
Universidade de Brasília
Universidade de São Paulo
publisher.none.fl_str_mv Pontificia Universidade Católica do Rio de Janeiro
Universidade de Brasília
Universidade de São Paulo
dc.source.none.fl_str_mv Psychology & Neuroscience v.6 n.3 2013
reponame:Psychology & Neuroscience (Online)
instname:Instituto Brasileiro de Neuropsicologia e Comportamento (IBNeC)
instacron:PUCRJ
instname_str Instituto Brasileiro de Neuropsicologia e Comportamento (IBNeC)
instacron_str PUCRJ
institution PUCRJ
reponame_str Psychology & Neuroscience (Online)
collection Psychology & Neuroscience (Online)
repository.name.fl_str_mv Psychology & Neuroscience (Online) - Instituto Brasileiro de Neuropsicologia e Comportamento (IBNeC)
repository.mail.fl_str_mv psycneuro@psycneuro.org
_version_ 1754821072923918336