Assessment of individual competence: A sequential mixed model 1

Detalhes bibliográficos
Autor(a) principal: Leppink, Jimmie
Data de Publicação: 2021
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Scientia Medica (Porto Alegre. Online)
Texto Completo: https://revistaseletronicas.pucrs.br/scientiamedica/article/view/41736
Resumo: Aims: the assessment of individual competence in medical education is about finding a balance between having sufficient resources to make valid and reliable decisions and not using more resources than necessary. Sequential assessment, in which more resources are used for borderline performing candidates than for poorly or clearly satisfactorily performing candidates, can be used to achieve that balance. Although sequential assessment is commonly associated with larger groups of candidates to be assessed, in many practical settings numbers of candidates may be small.Objective: this article presents a single case design with a statistical model for the assessment of individual competence that can be used regardless of the number of candidates.Method: a worked example of a solution that can be used for an individual candidate, using simulated data in the zero-cost Open Source statistical program R version 4.0.5., is provided.Results: the aforementioned solution provides statistics that can be used to make pass/fail decisions at the level of the individual candidate as well as to make decisions regarding the length and timing of an exam (or parts thereof) for the individual candidate.Conclusion: the solution provided can help to reduce resources needed for assessment to a considerable extent while maximizing resources for borderline candidates. This facilitates both decision making and cost reduction in assessment.
id PUC_RS-25_89074843feeeebeb8432570aa2effd58
oai_identifier_str oai:ojs.revistaseletronicas.pucrs.br:article/41736
network_acronym_str PUC_RS-25
network_name_str Scientia Medica (Porto Alegre. Online)
repository_id_str
spelling Assessment of individual competence: A sequential mixed model 1Avaliação da competência individual: Um modelo sequencial mistoassessmentcompetenceindividualmixed modelsequential assessmentavaliaçãocompetênciaindividualidademodelo mistoavaliação sequencialAims: the assessment of individual competence in medical education is about finding a balance between having sufficient resources to make valid and reliable decisions and not using more resources than necessary. Sequential assessment, in which more resources are used for borderline performing candidates than for poorly or clearly satisfactorily performing candidates, can be used to achieve that balance. Although sequential assessment is commonly associated with larger groups of candidates to be assessed, in many practical settings numbers of candidates may be small.Objective: this article presents a single case design with a statistical model for the assessment of individual competence that can be used regardless of the number of candidates.Method: a worked example of a solution that can be used for an individual candidate, using simulated data in the zero-cost Open Source statistical program R version 4.0.5., is provided.Results: the aforementioned solution provides statistics that can be used to make pass/fail decisions at the level of the individual candidate as well as to make decisions regarding the length and timing of an exam (or parts thereof) for the individual candidate.Conclusion: the solution provided can help to reduce resources needed for assessment to a considerable extent while maximizing resources for borderline candidates. This facilitates both decision making and cost reduction in assessment.Introdução: a avaliação da competência individual na educação médica consiste em encontrar um equilíbrio entre ter recursos suficientes para tomar decisões válidas e confiáveis e não usar mais recursos do que o necessário. A avaliação sequencial, na qual mais recursos são usados para candidatos limítrofes do que para candidatos com desempenho insatisfatório ou claramente satisfatório, pode ser usada para atingir esse equilíbrio. Embora a avaliação sequencial seja comumente associada a grupos maiores de candidatos a serem avaliados, em muitos ambientes práticos, o número de candidatos pode ser pequeno.Objetivo: este artigo apresenta um desenho de caso único com um modelo estatístico de avaliação de competência individual que pode ser utilizado independentemente do número de candidatos.Método: é fornecido um exemplo prático de uma solução que pode ser usada para um candidato individual, usando dados simulados no programa estatístico Open Source de custo zero R versão 4.0.5.Resultados: a solução mencionada fornece estatísticas que podem ser usadas para tomar decisões individuais de aprovação/ reprovação para cada candidato, bem como para tomar decisões individualizadas sobre a duração e o tempo de um exame (ou partes dele) para um candidato.Conclusão: a solução fornecida pode ajudar a reduzir consideravelmente os recursos necessários para a avaliação, ao mesmo tempo que maximiza os recursos para os candidatos limítrofes. Isso facilita a tomada de decisões e a redução de custos na avaliação.Editora da PUCRS - ediPUCRS2021-12-20info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdfhttps://revistaseletronicas.pucrs.br/scientiamedica/article/view/4173610.15448/1980-6108.2021.1.41736Scientia Medica; Vol. 31 No. 1 (2021): Single Volume; e41736Scientia Medica; v. 31 n. 1 (2021): Volume Único; e417361980-61081806-556210.15448/1980-6108.2021.1reponame:Scientia Medica (Porto Alegre. Online)instname:Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)instacron:PUC_RSenghttps://revistaseletronicas.pucrs.br/scientiamedica/article/view/41736/27272Copyright (c) 2021 Scientia Medicahttp://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessLeppink, Jimmie2022-01-31T16:36:47Zoai:ojs.revistaseletronicas.pucrs.br:article/41736Revistahttps://revistaseletronicas.pucrs.br/scientiamedica/PUBhttps://revistaseletronicas.pucrs.br/scientiamedica/oaiscientiamedica@pucrs.br || editora.periodicos@pucrs.br1980-61081806-5562opendoar:2022-01-31T16:36:47Scientia Medica (Porto Alegre. Online) - Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)false
dc.title.none.fl_str_mv Assessment of individual competence: A sequential mixed model 1
Avaliação da competência individual: Um modelo sequencial misto
title Assessment of individual competence: A sequential mixed model 1
spellingShingle Assessment of individual competence: A sequential mixed model 1
Leppink, Jimmie
assessment
competence
individual
mixed model
sequential assessment
avaliação
competência
individualidade
modelo misto
avaliação sequencial
title_short Assessment of individual competence: A sequential mixed model 1
title_full Assessment of individual competence: A sequential mixed model 1
title_fullStr Assessment of individual competence: A sequential mixed model 1
title_full_unstemmed Assessment of individual competence: A sequential mixed model 1
title_sort Assessment of individual competence: A sequential mixed model 1
author Leppink, Jimmie
author_facet Leppink, Jimmie
author_role author
dc.contributor.author.fl_str_mv Leppink, Jimmie
dc.subject.por.fl_str_mv assessment
competence
individual
mixed model
sequential assessment
avaliação
competência
individualidade
modelo misto
avaliação sequencial
topic assessment
competence
individual
mixed model
sequential assessment
avaliação
competência
individualidade
modelo misto
avaliação sequencial
description Aims: the assessment of individual competence in medical education is about finding a balance between having sufficient resources to make valid and reliable decisions and not using more resources than necessary. Sequential assessment, in which more resources are used for borderline performing candidates than for poorly or clearly satisfactorily performing candidates, can be used to achieve that balance. Although sequential assessment is commonly associated with larger groups of candidates to be assessed, in many practical settings numbers of candidates may be small.Objective: this article presents a single case design with a statistical model for the assessment of individual competence that can be used regardless of the number of candidates.Method: a worked example of a solution that can be used for an individual candidate, using simulated data in the zero-cost Open Source statistical program R version 4.0.5., is provided.Results: the aforementioned solution provides statistics that can be used to make pass/fail decisions at the level of the individual candidate as well as to make decisions regarding the length and timing of an exam (or parts thereof) for the individual candidate.Conclusion: the solution provided can help to reduce resources needed for assessment to a considerable extent while maximizing resources for borderline candidates. This facilitates both decision making and cost reduction in assessment.
publishDate 2021
dc.date.none.fl_str_mv 2021-12-20
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://revistaseletronicas.pucrs.br/scientiamedica/article/view/41736
10.15448/1980-6108.2021.1.41736
url https://revistaseletronicas.pucrs.br/scientiamedica/article/view/41736
identifier_str_mv 10.15448/1980-6108.2021.1.41736
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv https://revistaseletronicas.pucrs.br/scientiamedica/article/view/41736/27272
dc.rights.driver.fl_str_mv Copyright (c) 2021 Scientia Medica
http://creativecommons.org/licenses/by/4.0
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Copyright (c) 2021 Scientia Medica
http://creativecommons.org/licenses/by/4.0
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Editora da PUCRS - ediPUCRS
publisher.none.fl_str_mv Editora da PUCRS - ediPUCRS
dc.source.none.fl_str_mv Scientia Medica; Vol. 31 No. 1 (2021): Single Volume; e41736
Scientia Medica; v. 31 n. 1 (2021): Volume Único; e41736
1980-6108
1806-5562
10.15448/1980-6108.2021.1
reponame:Scientia Medica (Porto Alegre. Online)
instname:Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)
instacron:PUC_RS
instname_str Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)
instacron_str PUC_RS
institution PUC_RS
reponame_str Scientia Medica (Porto Alegre. Online)
collection Scientia Medica (Porto Alegre. Online)
repository.name.fl_str_mv Scientia Medica (Porto Alegre. Online) - Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)
repository.mail.fl_str_mv scientiamedica@pucrs.br || editora.periodicos@pucrs.br
_version_ 1809101752524341248