Assessment of individual competence: A sequential mixed model 1
Autor(a) principal: | |
---|---|
Data de Publicação: | 2021 |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Scientia Medica (Porto Alegre. Online) |
Texto Completo: | https://revistaseletronicas.pucrs.br/scientiamedica/article/view/41736 |
Resumo: | Aims: the assessment of individual competence in medical education is about finding a balance between having sufficient resources to make valid and reliable decisions and not using more resources than necessary. Sequential assessment, in which more resources are used for borderline performing candidates than for poorly or clearly satisfactorily performing candidates, can be used to achieve that balance. Although sequential assessment is commonly associated with larger groups of candidates to be assessed, in many practical settings numbers of candidates may be small.Objective: this article presents a single case design with a statistical model for the assessment of individual competence that can be used regardless of the number of candidates.Method: a worked example of a solution that can be used for an individual candidate, using simulated data in the zero-cost Open Source statistical program R version 4.0.5., is provided.Results: the aforementioned solution provides statistics that can be used to make pass/fail decisions at the level of the individual candidate as well as to make decisions regarding the length and timing of an exam (or parts thereof) for the individual candidate.Conclusion: the solution provided can help to reduce resources needed for assessment to a considerable extent while maximizing resources for borderline candidates. This facilitates both decision making and cost reduction in assessment. |
id |
PUC_RS-25_89074843feeeebeb8432570aa2effd58 |
---|---|
oai_identifier_str |
oai:ojs.revistaseletronicas.pucrs.br:article/41736 |
network_acronym_str |
PUC_RS-25 |
network_name_str |
Scientia Medica (Porto Alegre. Online) |
repository_id_str |
|
spelling |
Assessment of individual competence: A sequential mixed model 1Avaliação da competência individual: Um modelo sequencial mistoassessmentcompetenceindividualmixed modelsequential assessmentavaliaçãocompetênciaindividualidademodelo mistoavaliação sequencialAims: the assessment of individual competence in medical education is about finding a balance between having sufficient resources to make valid and reliable decisions and not using more resources than necessary. Sequential assessment, in which more resources are used for borderline performing candidates than for poorly or clearly satisfactorily performing candidates, can be used to achieve that balance. Although sequential assessment is commonly associated with larger groups of candidates to be assessed, in many practical settings numbers of candidates may be small.Objective: this article presents a single case design with a statistical model for the assessment of individual competence that can be used regardless of the number of candidates.Method: a worked example of a solution that can be used for an individual candidate, using simulated data in the zero-cost Open Source statistical program R version 4.0.5., is provided.Results: the aforementioned solution provides statistics that can be used to make pass/fail decisions at the level of the individual candidate as well as to make decisions regarding the length and timing of an exam (or parts thereof) for the individual candidate.Conclusion: the solution provided can help to reduce resources needed for assessment to a considerable extent while maximizing resources for borderline candidates. This facilitates both decision making and cost reduction in assessment.Introdução: a avaliação da competência individual na educação médica consiste em encontrar um equilíbrio entre ter recursos suficientes para tomar decisões válidas e confiáveis e não usar mais recursos do que o necessário. A avaliação sequencial, na qual mais recursos são usados para candidatos limítrofes do que para candidatos com desempenho insatisfatório ou claramente satisfatório, pode ser usada para atingir esse equilíbrio. Embora a avaliação sequencial seja comumente associada a grupos maiores de candidatos a serem avaliados, em muitos ambientes práticos, o número de candidatos pode ser pequeno.Objetivo: este artigo apresenta um desenho de caso único com um modelo estatístico de avaliação de competência individual que pode ser utilizado independentemente do número de candidatos.Método: é fornecido um exemplo prático de uma solução que pode ser usada para um candidato individual, usando dados simulados no programa estatístico Open Source de custo zero R versão 4.0.5.Resultados: a solução mencionada fornece estatísticas que podem ser usadas para tomar decisões individuais de aprovação/ reprovação para cada candidato, bem como para tomar decisões individualizadas sobre a duração e o tempo de um exame (ou partes dele) para um candidato.Conclusão: a solução fornecida pode ajudar a reduzir consideravelmente os recursos necessários para a avaliação, ao mesmo tempo que maximiza os recursos para os candidatos limítrofes. Isso facilita a tomada de decisões e a redução de custos na avaliação.Editora da PUCRS - ediPUCRS2021-12-20info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionapplication/pdfhttps://revistaseletronicas.pucrs.br/scientiamedica/article/view/4173610.15448/1980-6108.2021.1.41736Scientia Medica; Vol. 31 No. 1 (2021): Single Volume; e41736Scientia Medica; v. 31 n. 1 (2021): Volume Único; e417361980-61081806-556210.15448/1980-6108.2021.1reponame:Scientia Medica (Porto Alegre. Online)instname:Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)instacron:PUC_RSenghttps://revistaseletronicas.pucrs.br/scientiamedica/article/view/41736/27272Copyright (c) 2021 Scientia Medicahttp://creativecommons.org/licenses/by/4.0info:eu-repo/semantics/openAccessLeppink, Jimmie2022-01-31T16:36:47Zoai:ojs.revistaseletronicas.pucrs.br:article/41736Revistahttps://revistaseletronicas.pucrs.br/scientiamedica/PUBhttps://revistaseletronicas.pucrs.br/scientiamedica/oaiscientiamedica@pucrs.br || editora.periodicos@pucrs.br1980-61081806-5562opendoar:2022-01-31T16:36:47Scientia Medica (Porto Alegre. Online) - Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS)false |
dc.title.none.fl_str_mv |
Assessment of individual competence: A sequential mixed model 1 Avaliação da competência individual: Um modelo sequencial misto |
title |
Assessment of individual competence: A sequential mixed model 1 |
spellingShingle |
Assessment of individual competence: A sequential mixed model 1 Leppink, Jimmie assessment competence individual mixed model sequential assessment avaliação competência individualidade modelo misto avaliação sequencial |
title_short |
Assessment of individual competence: A sequential mixed model 1 |
title_full |
Assessment of individual competence: A sequential mixed model 1 |
title_fullStr |
Assessment of individual competence: A sequential mixed model 1 |
title_full_unstemmed |
Assessment of individual competence: A sequential mixed model 1 |
title_sort |
Assessment of individual competence: A sequential mixed model 1 |
author |
Leppink, Jimmie |
author_facet |
Leppink, Jimmie |
author_role |
author |
dc.contributor.author.fl_str_mv |
Leppink, Jimmie |
dc.subject.por.fl_str_mv |
assessment competence individual mixed model sequential assessment avaliação competência individualidade modelo misto avaliação sequencial |
topic |
assessment competence individual mixed model sequential assessment avaliação competência individualidade modelo misto avaliação sequencial |
description |
Aims: the assessment of individual competence in medical education is about finding a balance between having sufficient resources to make valid and reliable decisions and not using more resources than necessary. Sequential assessment, in which more resources are used for borderline performing candidates than for poorly or clearly satisfactorily performing candidates, can be used to achieve that balance. Although sequential assessment is commonly associated with larger groups of candidates to be assessed, in many practical settings numbers of candidates may be small.Objective: this article presents a single case design with a statistical model for the assessment of individual competence that can be used regardless of the number of candidates.Method: a worked example of a solution that can be used for an individual candidate, using simulated data in the zero-cost Open Source statistical program R version 4.0.5., is provided.Results: the aforementioned solution provides statistics that can be used to make pass/fail decisions at the level of the individual candidate as well as to make decisions regarding the length and timing of an exam (or parts thereof) for the individual candidate.Conclusion: the solution provided can help to reduce resources needed for assessment to a considerable extent while maximizing resources for borderline candidates. This facilitates both decision making and cost reduction in assessment. |
publishDate |
2021 |
dc.date.none.fl_str_mv |
2021-12-20 |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://revistaseletronicas.pucrs.br/scientiamedica/article/view/41736 10.15448/1980-6108.2021.1.41736 |
url |
https://revistaseletronicas.pucrs.br/scientiamedica/article/view/41736 |
identifier_str_mv |
10.15448/1980-6108.2021.1.41736 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
https://revistaseletronicas.pucrs.br/scientiamedica/article/view/41736/27272 |
dc.rights.driver.fl_str_mv |
Copyright (c) 2021 Scientia Medica http://creativecommons.org/licenses/by/4.0 info:eu-repo/semantics/openAccess |
rights_invalid_str_mv |
Copyright (c) 2021 Scientia Medica http://creativecommons.org/licenses/by/4.0 |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Editora da PUCRS - ediPUCRS |
publisher.none.fl_str_mv |
Editora da PUCRS - ediPUCRS |
dc.source.none.fl_str_mv |
Scientia Medica; Vol. 31 No. 1 (2021): Single Volume; e41736 Scientia Medica; v. 31 n. 1 (2021): Volume Único; e41736 1980-6108 1806-5562 10.15448/1980-6108.2021.1 reponame:Scientia Medica (Porto Alegre. Online) instname:Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS) instacron:PUC_RS |
instname_str |
Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS) |
instacron_str |
PUC_RS |
institution |
PUC_RS |
reponame_str |
Scientia Medica (Porto Alegre. Online) |
collection |
Scientia Medica (Porto Alegre. Online) |
repository.name.fl_str_mv |
Scientia Medica (Porto Alegre. Online) - Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS) |
repository.mail.fl_str_mv |
scientiamedica@pucrs.br || editora.periodicos@pucrs.br |
_version_ |
1809101752524341248 |