Validation of the Objective Structured Assessment of Technical Skill in Brasil
Autor(a) principal: | |
---|---|
Data de Publicação: | 2020 |
Outros Autores: | , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Revista da Associação Médica Brasileira (Online) |
Texto Completo: | http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0104-42302020000300328 |
Resumo: | SUMMARY BACKGROUND The aim of this study was to perform a cross-cultural adaptation of the Objective Structured Assessment of Technical Skill (OSATS) tool into Brazilian Portuguese and to determine its reproducibility and validity in Brasil. METHODS A Brazilian Portuguese version of OSATS was created through a process of translation, back-translation, expert panel evaluation, pilot testing, and then its validation. For the construct and the concurrent validities, twelve participants were divided into a group of six experts and six novices, who had to perform tasks on a simulation model using human placentas. Each participant was filmed, and two blinded raters would then evaluate their performance using the traditional subjective method and then the Brazilian Portuguese version of OSATS. RESULTS The Brazilian Portuguese version of OSATS had the face, content, construct, and concurrent validities achieved. The average experts’ score and standard deviations were 34 and 0.894, respectively, for Judge 1 and 34.33 and 0.816 for Judge 2. In the case of novices, it was 13.33 and 2.388 for Judge 1 and 13.33 and 3.204 for Judge 2. The concordance between the judges was evident, with the Correlation Coefficient (Pearson) of 0.9944 with CI 95% between 0.9797 and 0.9985, with p < 10-10, evidencing the excellent reproducibility of the instrument. CONCLUSION This preliminary study suggests that the Brazilian Portuguese version of OSATS can reliably and validly assess surgical skills in Brasil. |
id |
AMB-1_26bbe908fe64abc4cbe4ba26522bcf7e |
---|---|
oai_identifier_str |
oai:scielo:S0104-42302020000300328 |
network_acronym_str |
AMB-1 |
network_name_str |
Revista da Associação Médica Brasileira (Online) |
repository_id_str |
|
spelling |
Validation of the Objective Structured Assessment of Technical Skill in BrasilEducational measurementSimulationTrainingSurgical procedures, operative/educationSurveys and questionnairesSUMMARY BACKGROUND The aim of this study was to perform a cross-cultural adaptation of the Objective Structured Assessment of Technical Skill (OSATS) tool into Brazilian Portuguese and to determine its reproducibility and validity in Brasil. METHODS A Brazilian Portuguese version of OSATS was created through a process of translation, back-translation, expert panel evaluation, pilot testing, and then its validation. For the construct and the concurrent validities, twelve participants were divided into a group of six experts and six novices, who had to perform tasks on a simulation model using human placentas. Each participant was filmed, and two blinded raters would then evaluate their performance using the traditional subjective method and then the Brazilian Portuguese version of OSATS. RESULTS The Brazilian Portuguese version of OSATS had the face, content, construct, and concurrent validities achieved. The average experts’ score and standard deviations were 34 and 0.894, respectively, for Judge 1 and 34.33 and 0.816 for Judge 2. In the case of novices, it was 13.33 and 2.388 for Judge 1 and 13.33 and 3.204 for Judge 2. The concordance between the judges was evident, with the Correlation Coefficient (Pearson) of 0.9944 with CI 95% between 0.9797 and 0.9985, with p < 10-10, evidencing the excellent reproducibility of the instrument. CONCLUSION This preliminary study suggests that the Brazilian Portuguese version of OSATS can reliably and validly assess surgical skills in Brasil.Associação Médica Brasileira2020-03-01info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersiontext/htmlhttp://old.scielo.br/scielo.php?script=sci_arttext&pid=S0104-42302020000300328Revista da Associação Médica Brasileira v.66 n.3 2020reponame:Revista da Associação Médica Brasileira (Online)instname:Associação Médica Brasileira (AMB)instacron:AMB10.1590/1806-9282.66.3.328info:eu-repo/semantics/openAccessCampos,Marcelo Esteves ChavesOliveira,Marcelo Magaldi Ribeiro deAssis,Lilian Bambirra deReis,Augusto BarbosaGonçalves,Flávio Bambirraeng2020-05-29T00:00:00Zoai:scielo:S0104-42302020000300328Revistahttps://ramb.amb.org.br/ultimas-edicoes/#https://old.scielo.br/oai/scielo-oai.php||ramb@amb.org.br1806-92820104-4230opendoar:2020-05-29T00:00Revista da Associação Médica Brasileira (Online) - Associação Médica Brasileira (AMB)false |
dc.title.none.fl_str_mv |
Validation of the Objective Structured Assessment of Technical Skill in Brasil |
title |
Validation of the Objective Structured Assessment of Technical Skill in Brasil |
spellingShingle |
Validation of the Objective Structured Assessment of Technical Skill in Brasil Campos,Marcelo Esteves Chaves Educational measurement Simulation Training Surgical procedures, operative/education Surveys and questionnaires |
title_short |
Validation of the Objective Structured Assessment of Technical Skill in Brasil |
title_full |
Validation of the Objective Structured Assessment of Technical Skill in Brasil |
title_fullStr |
Validation of the Objective Structured Assessment of Technical Skill in Brasil |
title_full_unstemmed |
Validation of the Objective Structured Assessment of Technical Skill in Brasil |
title_sort |
Validation of the Objective Structured Assessment of Technical Skill in Brasil |
author |
Campos,Marcelo Esteves Chaves |
author_facet |
Campos,Marcelo Esteves Chaves Oliveira,Marcelo Magaldi Ribeiro de Assis,Lilian Bambirra de Reis,Augusto Barbosa Gonçalves,Flávio Bambirra |
author_role |
author |
author2 |
Oliveira,Marcelo Magaldi Ribeiro de Assis,Lilian Bambirra de Reis,Augusto Barbosa Gonçalves,Flávio Bambirra |
author2_role |
author author author author |
dc.contributor.author.fl_str_mv |
Campos,Marcelo Esteves Chaves Oliveira,Marcelo Magaldi Ribeiro de Assis,Lilian Bambirra de Reis,Augusto Barbosa Gonçalves,Flávio Bambirra |
dc.subject.por.fl_str_mv |
Educational measurement Simulation Training Surgical procedures, operative/education Surveys and questionnaires |
topic |
Educational measurement Simulation Training Surgical procedures, operative/education Surveys and questionnaires |
description |
SUMMARY BACKGROUND The aim of this study was to perform a cross-cultural adaptation of the Objective Structured Assessment of Technical Skill (OSATS) tool into Brazilian Portuguese and to determine its reproducibility and validity in Brasil. METHODS A Brazilian Portuguese version of OSATS was created through a process of translation, back-translation, expert panel evaluation, pilot testing, and then its validation. For the construct and the concurrent validities, twelve participants were divided into a group of six experts and six novices, who had to perform tasks on a simulation model using human placentas. Each participant was filmed, and two blinded raters would then evaluate their performance using the traditional subjective method and then the Brazilian Portuguese version of OSATS. RESULTS The Brazilian Portuguese version of OSATS had the face, content, construct, and concurrent validities achieved. The average experts’ score and standard deviations were 34 and 0.894, respectively, for Judge 1 and 34.33 and 0.816 for Judge 2. In the case of novices, it was 13.33 and 2.388 for Judge 1 and 13.33 and 3.204 for Judge 2. The concordance between the judges was evident, with the Correlation Coefficient (Pearson) of 0.9944 with CI 95% between 0.9797 and 0.9985, with p < 10-10, evidencing the excellent reproducibility of the instrument. CONCLUSION This preliminary study suggests that the Brazilian Portuguese version of OSATS can reliably and validly assess surgical skills in Brasil. |
publishDate |
2020 |
dc.date.none.fl_str_mv |
2020-03-01 |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0104-42302020000300328 |
url |
http://old.scielo.br/scielo.php?script=sci_arttext&pid=S0104-42302020000300328 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
10.1590/1806-9282.66.3.328 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
text/html |
dc.publisher.none.fl_str_mv |
Associação Médica Brasileira |
publisher.none.fl_str_mv |
Associação Médica Brasileira |
dc.source.none.fl_str_mv |
Revista da Associação Médica Brasileira v.66 n.3 2020 reponame:Revista da Associação Médica Brasileira (Online) instname:Associação Médica Brasileira (AMB) instacron:AMB |
instname_str |
Associação Médica Brasileira (AMB) |
instacron_str |
AMB |
institution |
AMB |
reponame_str |
Revista da Associação Médica Brasileira (Online) |
collection |
Revista da Associação Médica Brasileira (Online) |
repository.name.fl_str_mv |
Revista da Associação Médica Brasileira (Online) - Associação Médica Brasileira (AMB) |
repository.mail.fl_str_mv |
||ramb@amb.org.br |
_version_ |
1754212834779070464 |