Cognitive screening instruments for dementia: comparing metrics of test limitation

Detalhes bibliográficos
Autor(a) principal: Larner,Andrew J.
Data de Publicação: 2021
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Dementia & Neuropsychologia
Texto Completo: http://old.scielo.br/scielo.php?script=sci_arttext&pid=S1980-57642021000400458
Resumo: ABSTRACT Cognitive screening instruments (CSIs) for dementia and mild cognitive impairment are usually characterized in terms of measures of discrimination such as sensitivity, specificity, and likelihood ratios, but these CSIs also have limitations. Objective: The aim of this study was to calculate various measures of test limitation for commonly used CSIs, namely, misclassification rate (MR), net harm/net benefit ratio (H/B), and the likelihood to be diagnosed or misdiagnosed (LDM). Methods: Data from several previously reported pragmatic test accuracy studies of CSIs (Mini-Mental State Examination, the Montreal Cognitive Assessment, Mini-Addenbrooke’s Cognitive Examination, Six-item Cognitive Impairment Test, informant Ascertain Dementia 8, Test Your Memory test, and Free-Cog) undertaken in a single clinic were reanalyzed to calculate and compare MR, H/B, and the LDM for each test. Results: Some CSIs with very high sensitivity but low specificity for dementia fared poorly on measures of limitation, with high MRs, low H/B, and low LDM; some had likelihoods favoring misdiagnosis over diagnosis. Tests with a better balance of sensitivity and specificity fared better on measures of limitation. Conclusions: When deciding which CSI to administer, measures of test limitation as well as measures of test discrimination should be considered. Identification of CSIs with high MR, low H/B, and low LDM, may have implications for their use in clinical practice.
id ANCC-1_81485f2199f0f6fd6870a22bf1c937d5
oai_identifier_str oai:scielo:S1980-57642021000400458
network_acronym_str ANCC-1
network_name_str Dementia & Neuropsychologia
repository_id_str
spelling Cognitive screening instruments for dementia: comparing metrics of test limitationcognitive screeningdementiadiagnosislimitationsmemory clinicABSTRACT Cognitive screening instruments (CSIs) for dementia and mild cognitive impairment are usually characterized in terms of measures of discrimination such as sensitivity, specificity, and likelihood ratios, but these CSIs also have limitations. Objective: The aim of this study was to calculate various measures of test limitation for commonly used CSIs, namely, misclassification rate (MR), net harm/net benefit ratio (H/B), and the likelihood to be diagnosed or misdiagnosed (LDM). Methods: Data from several previously reported pragmatic test accuracy studies of CSIs (Mini-Mental State Examination, the Montreal Cognitive Assessment, Mini-Addenbrooke’s Cognitive Examination, Six-item Cognitive Impairment Test, informant Ascertain Dementia 8, Test Your Memory test, and Free-Cog) undertaken in a single clinic were reanalyzed to calculate and compare MR, H/B, and the LDM for each test. Results: Some CSIs with very high sensitivity but low specificity for dementia fared poorly on measures of limitation, with high MRs, low H/B, and low LDM; some had likelihoods favoring misdiagnosis over diagnosis. Tests with a better balance of sensitivity and specificity fared better on measures of limitation. Conclusions: When deciding which CSI to administer, measures of test limitation as well as measures of test discrimination should be considered. Identification of CSIs with high MR, low H/B, and low LDM, may have implications for their use in clinical practice.Academia Brasileira de Neurologia, Departamento de Neurologia Cognitiva e Envelhecimento2021-12-01info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersiontext/htmlhttp://old.scielo.br/scielo.php?script=sci_arttext&pid=S1980-57642021000400458Dementia & Neuropsychologia v.15 n.4 2021reponame:Dementia & Neuropsychologiainstname:Associação de Neurologia Cognitiva e do Comportamento (ANCC)instacron:ANCC10.1590/1980-57642021dn15-040005info:eu-repo/semantics/openAccessLarner,Andrew J.eng2021-12-01T00:00:00Zoai:scielo:S1980-57642021000400458Revistahttp://www.demneuropsy.com.br/ONGhttps://old.scielo.br/oai/scielo-oai.php||demneuropsy@uol.com.br1980-57641980-5764opendoar:2021-12-01T00:00Dementia & Neuropsychologia - Associação de Neurologia Cognitiva e do Comportamento (ANCC)false
dc.title.none.fl_str_mv Cognitive screening instruments for dementia: comparing metrics of test limitation
title Cognitive screening instruments for dementia: comparing metrics of test limitation
spellingShingle Cognitive screening instruments for dementia: comparing metrics of test limitation
Larner,Andrew J.
cognitive screening
dementia
diagnosis
limitations
memory clinic
title_short Cognitive screening instruments for dementia: comparing metrics of test limitation
title_full Cognitive screening instruments for dementia: comparing metrics of test limitation
title_fullStr Cognitive screening instruments for dementia: comparing metrics of test limitation
title_full_unstemmed Cognitive screening instruments for dementia: comparing metrics of test limitation
title_sort Cognitive screening instruments for dementia: comparing metrics of test limitation
author Larner,Andrew J.
author_facet Larner,Andrew J.
author_role author
dc.contributor.author.fl_str_mv Larner,Andrew J.
dc.subject.por.fl_str_mv cognitive screening
dementia
diagnosis
limitations
memory clinic
topic cognitive screening
dementia
diagnosis
limitations
memory clinic
description ABSTRACT Cognitive screening instruments (CSIs) for dementia and mild cognitive impairment are usually characterized in terms of measures of discrimination such as sensitivity, specificity, and likelihood ratios, but these CSIs also have limitations. Objective: The aim of this study was to calculate various measures of test limitation for commonly used CSIs, namely, misclassification rate (MR), net harm/net benefit ratio (H/B), and the likelihood to be diagnosed or misdiagnosed (LDM). Methods: Data from several previously reported pragmatic test accuracy studies of CSIs (Mini-Mental State Examination, the Montreal Cognitive Assessment, Mini-Addenbrooke’s Cognitive Examination, Six-item Cognitive Impairment Test, informant Ascertain Dementia 8, Test Your Memory test, and Free-Cog) undertaken in a single clinic were reanalyzed to calculate and compare MR, H/B, and the LDM for each test. Results: Some CSIs with very high sensitivity but low specificity for dementia fared poorly on measures of limitation, with high MRs, low H/B, and low LDM; some had likelihoods favoring misdiagnosis over diagnosis. Tests with a better balance of sensitivity and specificity fared better on measures of limitation. Conclusions: When deciding which CSI to administer, measures of test limitation as well as measures of test discrimination should be considered. Identification of CSIs with high MR, low H/B, and low LDM, may have implications for their use in clinical practice.
publishDate 2021
dc.date.none.fl_str_mv 2021-12-01
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://old.scielo.br/scielo.php?script=sci_arttext&pid=S1980-57642021000400458
url http://old.scielo.br/scielo.php?script=sci_arttext&pid=S1980-57642021000400458
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 10.1590/1980-57642021dn15-040005
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv text/html
dc.publisher.none.fl_str_mv Academia Brasileira de Neurologia, Departamento de Neurologia Cognitiva e Envelhecimento
publisher.none.fl_str_mv Academia Brasileira de Neurologia, Departamento de Neurologia Cognitiva e Envelhecimento
dc.source.none.fl_str_mv Dementia & Neuropsychologia v.15 n.4 2021
reponame:Dementia & Neuropsychologia
instname:Associação de Neurologia Cognitiva e do Comportamento (ANCC)
instacron:ANCC
instname_str Associação de Neurologia Cognitiva e do Comportamento (ANCC)
instacron_str ANCC
institution ANCC
reponame_str Dementia & Neuropsychologia
collection Dementia & Neuropsychologia
repository.name.fl_str_mv Dementia & Neuropsychologia - Associação de Neurologia Cognitiva e do Comportamento (ANCC)
repository.mail.fl_str_mv ||demneuropsy@uol.com.br
_version_ 1754212932811489280