The Validity Concept in Medical Education: a Bibliometric Analysis
Autor(a) principal: | |
---|---|
Data de Publicação: | 2020 |
Outros Autores: | , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Revista Brasileira de Educação Médica (Online) |
Texto Completo: | http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0100-55022020000400303 |
Resumo: | Abstract: Introduction: Assessment is a critical part of learning and validity is arguably its most important aspect. However, different views and beliefs led to a fragmented conception of the validity meaning, with an excessive focus on psychometric methods and scores, neglecting the consequences and utility of the test. The last decades witnessed the creation of a significant number of tests to assess different aspects of the medical profession formation, but researchers frequently limit their conclusions to the consistency of their measurements, without any further analysis on the educational and social impacts of the test. The objective of this work is to determine the predominant concept of validity in medical education assessment studies. Method: The authors conducted a bibliometric research of the literature about studies on the assessment of learning of medical students, to determine the prevalent concept of validity. The research covered a period from January 2001 to august 2019. The studies were classified in two categories based on their approach to validity: (1)” fragmented validity concept” and (2)” unified validity concept”. To help with validity arguments, the studies were also classified based on Miller’s framework for clinical assessment. Results: From an initial search resulting in 2823 studies, 716 studies were selected based on the eligibility criteria, and from the selected list, of which 693 (96,7%) were considered studies of the fragmented validity concept, which prioritized score results over an analysis of the test's utility, and only 23 studies (3,2%) were aligned with a unified view of validity, showing an explicit analysis of the consequences and utility of the test. Although the last decade witnessed a significant increase in the number of assessment studies, this increase was not followed by a significant change in the validity concept. Conclusions: This bibliometric analysis demonstrated that assessment studies in medical education still have a fragmented concept of validity, restricted to psychometric methods and scores. The vast majority of studies are not committed to the analysis about the utility and educational impact of an assessment policy. This restrictive view can lead to the waste of valuable time and resources related to assessment methods without significant educational consequences. |
id |
ABEM-1_34ef18cebbca9edc92e2c5aba02637bd |
---|---|
oai_identifier_str |
oai:scielo:S0100-55022020000400303 |
network_acronym_str |
ABEM-1 |
network_name_str |
Revista Brasileira de Educação Médica (Online) |
repository_id_str |
|
spelling |
The Validity Concept in Medical Education: a Bibliometric AnalysisValidityMedical EducationAssessmentAbstract: Introduction: Assessment is a critical part of learning and validity is arguably its most important aspect. However, different views and beliefs led to a fragmented conception of the validity meaning, with an excessive focus on psychometric methods and scores, neglecting the consequences and utility of the test. The last decades witnessed the creation of a significant number of tests to assess different aspects of the medical profession formation, but researchers frequently limit their conclusions to the consistency of their measurements, without any further analysis on the educational and social impacts of the test. The objective of this work is to determine the predominant concept of validity in medical education assessment studies. Method: The authors conducted a bibliometric research of the literature about studies on the assessment of learning of medical students, to determine the prevalent concept of validity. The research covered a period from January 2001 to august 2019. The studies were classified in two categories based on their approach to validity: (1)” fragmented validity concept” and (2)” unified validity concept”. To help with validity arguments, the studies were also classified based on Miller’s framework for clinical assessment. Results: From an initial search resulting in 2823 studies, 716 studies were selected based on the eligibility criteria, and from the selected list, of which 693 (96,7%) were considered studies of the fragmented validity concept, which prioritized score results over an analysis of the test's utility, and only 23 studies (3,2%) were aligned with a unified view of validity, showing an explicit analysis of the consequences and utility of the test. Although the last decade witnessed a significant increase in the number of assessment studies, this increase was not followed by a significant change in the validity concept. Conclusions: This bibliometric analysis demonstrated that assessment studies in medical education still have a fragmented concept of validity, restricted to psychometric methods and scores. The vast majority of studies are not committed to the analysis about the utility and educational impact of an assessment policy. This restrictive view can lead to the waste of valuable time and resources related to assessment methods without significant educational consequences.Associação Brasileira de Educação Médica2020-01-01info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersiontext/htmlhttp://old.scielo.br/scielo.php?script=sci_arttext&pid=S0100-55022020000400303Revista Brasileira de Educação Médica v.44 n.4 2020reponame:Revista Brasileira de Educação Médica (Online)instname:Associação Brasileira de Educação Médica (ABEM)instacron:ABEM10.1590/1981-5271v44.4-20200055.inginfo:eu-repo/semantics/openAccessSouza,Ruy Guilherme Silveira deSequeira,Bianca JorgeMartins,Antonio Carlos SanseveroBicudo,Angélica Mariaeng2020-11-13T00:00:00Zoai:scielo:S0100-55022020000400303Revistahttp://www.educacaomedica.org.br/https://old.scielo.br/oai/scielo-oai.phprevista@abem-educmed.org.br||revista@educacaomedica.org.br1981-52710100-5502opendoar:2020-11-13T00:00Revista Brasileira de Educação Médica (Online) - Associação Brasileira de Educação Médica (ABEM)false |
dc.title.none.fl_str_mv |
The Validity Concept in Medical Education: a Bibliometric Analysis |
title |
The Validity Concept in Medical Education: a Bibliometric Analysis |
spellingShingle |
The Validity Concept in Medical Education: a Bibliometric Analysis Souza,Ruy Guilherme Silveira de Validity Medical Education Assessment |
title_short |
The Validity Concept in Medical Education: a Bibliometric Analysis |
title_full |
The Validity Concept in Medical Education: a Bibliometric Analysis |
title_fullStr |
The Validity Concept in Medical Education: a Bibliometric Analysis |
title_full_unstemmed |
The Validity Concept in Medical Education: a Bibliometric Analysis |
title_sort |
The Validity Concept in Medical Education: a Bibliometric Analysis |
author |
Souza,Ruy Guilherme Silveira de |
author_facet |
Souza,Ruy Guilherme Silveira de Sequeira,Bianca Jorge Martins,Antonio Carlos Sansevero Bicudo,Angélica Maria |
author_role |
author |
author2 |
Sequeira,Bianca Jorge Martins,Antonio Carlos Sansevero Bicudo,Angélica Maria |
author2_role |
author author author |
dc.contributor.author.fl_str_mv |
Souza,Ruy Guilherme Silveira de Sequeira,Bianca Jorge Martins,Antonio Carlos Sansevero Bicudo,Angélica Maria |
dc.subject.por.fl_str_mv |
Validity Medical Education Assessment |
topic |
Validity Medical Education Assessment |
description |
Abstract: Introduction: Assessment is a critical part of learning and validity is arguably its most important aspect. However, different views and beliefs led to a fragmented conception of the validity meaning, with an excessive focus on psychometric methods and scores, neglecting the consequences and utility of the test. The last decades witnessed the creation of a significant number of tests to assess different aspects of the medical profession formation, but researchers frequently limit their conclusions to the consistency of their measurements, without any further analysis on the educational and social impacts of the test. The objective of this work is to determine the predominant concept of validity in medical education assessment studies. Method: The authors conducted a bibliometric research of the literature about studies on the assessment of learning of medical students, to determine the prevalent concept of validity. The research covered a period from January 2001 to august 2019. The studies were classified in two categories based on their approach to validity: (1)” fragmented validity concept” and (2)” unified validity concept”. To help with validity arguments, the studies were also classified based on Miller’s framework for clinical assessment. Results: From an initial search resulting in 2823 studies, 716 studies were selected based on the eligibility criteria, and from the selected list, of which 693 (96,7%) were considered studies of the fragmented validity concept, which prioritized score results over an analysis of the test's utility, and only 23 studies (3,2%) were aligned with a unified view of validity, showing an explicit analysis of the consequences and utility of the test. Although the last decade witnessed a significant increase in the number of assessment studies, this increase was not followed by a significant change in the validity concept. Conclusions: This bibliometric analysis demonstrated that assessment studies in medical education still have a fragmented concept of validity, restricted to psychometric methods and scores. The vast majority of studies are not committed to the analysis about the utility and educational impact of an assessment policy. This restrictive view can lead to the waste of valuable time and resources related to assessment methods without significant educational consequences. |
publishDate |
2020 |
dc.date.none.fl_str_mv |
2020-01-01 |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0100-55022020000400303 |
url |
http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0100-55022020000400303 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
10.1590/1981-5271v44.4-20200055.ing |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
text/html |
dc.publisher.none.fl_str_mv |
Associação Brasileira de Educação Médica |
publisher.none.fl_str_mv |
Associação Brasileira de Educação Médica |
dc.source.none.fl_str_mv |
Revista Brasileira de Educação Médica v.44 n.4 2020 reponame:Revista Brasileira de Educação Médica (Online) instname:Associação Brasileira de Educação Médica (ABEM) instacron:ABEM |
instname_str |
Associação Brasileira de Educação Médica (ABEM) |
instacron_str |
ABEM |
institution |
ABEM |
reponame_str |
Revista Brasileira de Educação Médica (Online) |
collection |
Revista Brasileira de Educação Médica (Online) |
repository.name.fl_str_mv |
Revista Brasileira de Educação Médica (Online) - Associação Brasileira de Educação Médica (ABEM) |
repository.mail.fl_str_mv |
revista@abem-educmed.org.br||revista@educacaomedica.org.br |
_version_ |
1754303008272809984 |