Avaliação formativa de estudantes de enfermagem em estágio curricular supervisionado

Detalhes bibliográficos
Autor(a) principal: Ramos, Tierle Kosloski
Data de Publicação: 2024
Tipo de documento: Tese
Idioma: por
Título da fonte: Manancial - Repositório Digital da UFSM
dARK ID: ark:/26339/0013000001m4p
Texto Completo: http://repositorio.ufsm.br/handle/1/31928
Resumo: The Supervised Curricular Internship provides nursing students with the opportunity to experience everyday situations in the work of nurses, through the acquisition and improvement of skills and competencies that underpin professional practice. In this training context, with regard to learning assessment, it is recommended to use strategies that enable diagnostic, formative and summative assessment. General objective: To develop an instrument for the formative assessment of nursing students in supervised curricular internships. Specific objectives: to develop an Instrument for Formative Assessment of Nursing Students in Supervised Curricular Internships; to validate the content of the instrument with a panel of experts; to evaluate the usability and reliability of the Instrument for Formative Assessment of Nursing Students in Supervised Curricular Internships with the target audience. Method: a methodological, quasi-experimental before-and-after study, carried out in three stages: preparation, validation and evaluation of the instrument, supported by Philippe Perrenoud's theoretical framework of formative assessment. The instrument was developed in January 2023, based on an integrative literature review and official documents from the Ministry of Education and Culture, the Federal Nursing Council and the Brazilian Nursing Association. Validation took place between June and September 2023, using the modified e-Delphi technique. The data was collected online using the Google forms® tool, with the instrument presented in the form of a four-point Likert scale, in which 12 psychometric criteria were assessed. In the first round, 24 experts took part, while in the second round, 12 experts were located through searches on the curriculum lattes platform, institutional websites and snowball sampling. To evaluate the instrument, a quasi-experimental before-and-after study was carried out between October and December 2023 with the target audience (students, supervising nurses and teachers), using the Instrument for Formative Evaluation of Nursing Students in Supervised Curricular Internships. The data was stored in spreadsheets and then analyzed using the Statistical Package for Social Sciences (SPSS)® version 28.0. The reliability and internal consistency of the instrument was analyzed using the Cronbach's alpha coefficient, and the overall validation of the psychometric criteria, as well as the blocks and items of the instrument, was assessed using the Content Validity Index, with CVI ≥ 0.80 being considered adequate. The variables were described by mean and standard deviation and compared between the groups using one-way ANOVA. For the comparison between the domains, ANOVA for repeated measures together with the Bonferroni test was applied. The test and retest results were evaluated using both the Student's t-test for paired samples and the Intraclass Correlation Coefficient. Results: In the first round, 24 experts participated, evaluating the instrument with a CVI of 0.89. In the second round, 12 experts took part, obtaining a final validity index of 0.92 and a reliability of 0.993. In the evaluation with the target audience, there was agreement between the groups on the mean scores of the domains. The instrument proved to be reliable with a Cronbach's alpha of 0.95. In some items, there was low agreement and a significant difference, with no possibility of reproducibility. The domains showed agreement and reproducibility. No sensitivity to change was identified. Conclusion: The instrument was validated by a panel of experts representing all regions of the country, obtaining an adequate evaluation of the items and domains, as well as the other guiding elements, demonstrating that the instrument is valid and reliable. The instrument has the reliability and reproducibility to be implemented in the formative evaluation of internship learning.
id UFSM_8d610a44e244ad65681ed22aa743bcd6
oai_identifier_str oai:repositorio.ufsm.br:1/31928
network_acronym_str UFSM
network_name_str Manancial - Repositório Digital da UFSM
repository_id_str
spelling Avaliação formativa de estudantes de enfermagem em estágio curricular supervisionadoFormative evaluation of nursing students in supervised curricular internshipEnfermagemEducação em enfermagemEstágiosAvaliação educacionalDesempenho acadêmicoNursingNursing educationInternshipsEducational evaluationAcademic performanceCNPQ::CIENCIAS DA SAUDE::ENFERMAGEMThe Supervised Curricular Internship provides nursing students with the opportunity to experience everyday situations in the work of nurses, through the acquisition and improvement of skills and competencies that underpin professional practice. In this training context, with regard to learning assessment, it is recommended to use strategies that enable diagnostic, formative and summative assessment. General objective: To develop an instrument for the formative assessment of nursing students in supervised curricular internships. Specific objectives: to develop an Instrument for Formative Assessment of Nursing Students in Supervised Curricular Internships; to validate the content of the instrument with a panel of experts; to evaluate the usability and reliability of the Instrument for Formative Assessment of Nursing Students in Supervised Curricular Internships with the target audience. Method: a methodological, quasi-experimental before-and-after study, carried out in three stages: preparation, validation and evaluation of the instrument, supported by Philippe Perrenoud's theoretical framework of formative assessment. The instrument was developed in January 2023, based on an integrative literature review and official documents from the Ministry of Education and Culture, the Federal Nursing Council and the Brazilian Nursing Association. Validation took place between June and September 2023, using the modified e-Delphi technique. The data was collected online using the Google forms® tool, with the instrument presented in the form of a four-point Likert scale, in which 12 psychometric criteria were assessed. In the first round, 24 experts took part, while in the second round, 12 experts were located through searches on the curriculum lattes platform, institutional websites and snowball sampling. To evaluate the instrument, a quasi-experimental before-and-after study was carried out between October and December 2023 with the target audience (students, supervising nurses and teachers), using the Instrument for Formative Evaluation of Nursing Students in Supervised Curricular Internships. The data was stored in spreadsheets and then analyzed using the Statistical Package for Social Sciences (SPSS)® version 28.0. The reliability and internal consistency of the instrument was analyzed using the Cronbach's alpha coefficient, and the overall validation of the psychometric criteria, as well as the blocks and items of the instrument, was assessed using the Content Validity Index, with CVI ≥ 0.80 being considered adequate. The variables were described by mean and standard deviation and compared between the groups using one-way ANOVA. For the comparison between the domains, ANOVA for repeated measures together with the Bonferroni test was applied. The test and retest results were evaluated using both the Student's t-test for paired samples and the Intraclass Correlation Coefficient. Results: In the first round, 24 experts participated, evaluating the instrument with a CVI of 0.89. In the second round, 12 experts took part, obtaining a final validity index of 0.92 and a reliability of 0.993. In the evaluation with the target audience, there was agreement between the groups on the mean scores of the domains. The instrument proved to be reliable with a Cronbach's alpha of 0.95. In some items, there was low agreement and a significant difference, with no possibility of reproducibility. The domains showed agreement and reproducibility. No sensitivity to change was identified. Conclusion: The instrument was validated by a panel of experts representing all regions of the country, obtaining an adequate evaluation of the items and domains, as well as the other guiding elements, demonstrating that the instrument is valid and reliable. The instrument has the reliability and reproducibility to be implemented in the formative evaluation of internship learning.O Estágio Curricular Supervisionado oportuniza ao estudante de enfermagem vivenciar situações do cotidiano de trabalho do enfermeiro, por meio da aquisição e aperfeiçoamento de habilidades e competências que fundamentam o exercício profissional. Neste contexto formativo, no que diz respeito à avaliação da aprendizagem, recomenda-se o uso de estratégias que permitam a avaliação diagnóstica, formativa e somativa. Objetivo geral: Desenvolver um Instrumento para Avaliação Formativa de Estudantes de Enfermagem em Estágio Curricular Supervisionado. Objetivos específicos: elaborar um Instrumento para Avaliação Formativa de Estudantes de Enfermagem em Estágio Curricular Supervisionado; validar o conteúdo do instrumento com um painel de especialistas; avaliar com o público-alvo a usabilidade e confiabilidade do Instrumento para Avaliação Formativa de Estudantes de Enfermagem em Estágio Curricular Supervisionado. Método: estudo metodológico, quase-experimental do tipo antes e depois, realizado em três etapas: elaboração, validação e avaliação do instrumento, sustentada pelo referencial teórico de avaliação formativa de Philippe Perrenoud. A etapa de elaboração do instrumento ocorreu no mês de janeiro de 2023, embasado por uma revisão integrativa de literatura e em documentos oficiais do Ministério da Educação e Cultura, Conselho Federal de Enfermagem e Associação Brasileira de Enfermagem. A validação ocorreu no período de junho a setembro de 2023, por meio da técnica e-Delphi modificada. Os dados foram coletados de forma on-line por meio da ferramenta do Google forms®, com instrumento apresentado sob forma de escala do tipo Likert de quatro pontos, em que foram avaliados 12 critérios psicométricos. Na primeira rodada participaram 24 especialistas, enquanto na segunda 12 especialistas, que foram localizados por meio de pesquisas na plataforma do curriculum lattes, em sites institucionais e também por meio da amostragem em bola de neve. Para a avaliação do instrumento realizou-se um estudo quase-experimental do tipo antes e depois, entre outubro e dezembro de 2023, com o público alvo (estudantes, enfermeiros supervisores e docentes), por meio do uso do Instrumento para Avaliação Formativa de Estudantes de Enfermagem em Estágio Curricular Supervisionado. Os dados foram armazenados em planilhas, sendo posteriormente analisados por meio do Statistical Package for Social Sciences (SPSS)® versão 28.0. A avaliação da confiabilidade e consistência interna do instrumento foi analisada a partir do coeficiente do alfa de Cronbach, a validação global dos critérios psicométricos, bem como dos blocos e itens do instrumento, foi avaliada pelo Índice de Validade de Conteúdo, sendo considerado adequado IVC ≥ que 0,80. As variáveis foram descritas por média e desvio padrão e comparadas entre os grupos através da ANOVA one-way. Para a comparação entre os domínios, a ANOVA para medidas repetidas em conjunto com o teste de Bonferroni foi aplicada. Os resultados do teste e reteste foram avaliados tanto pelo teste t-student para amostras pareadas, quanto pelo Coeficiente de Correlação Intraclasse. Resultados: Na primeira rodada, participaram 24 especialistas, avaliando o instrumento com IVC de 0,89. Na segunda rodada participaram 12 especialistas, obtendo índice de validade final de 0,92, a confiabilidade foi de 0,993. Na avaliação com o público alvo, houve concordância entre grupos nas médias dos domínios. O instrumento demonstrou-se confiável com alfa de Cronbach de 0,95. Em alguns itens, houve baixa concordância e uma diferença significativa, não havendo possibilidade de reprodutibilidade. Os domínios demonstraram concordância e reprodutibilidade. Não identificou-se sensibilidade à mudança. Conclusão: O instrumento foi validado por um painel de especialistas, representando todas as regiões do país, obtendo-se uma avaliação adequada dos itens e dos domínios, bem como dos demais elementos orientadores, demonstrando que o instrumento é válido e confiável. O instrumento apresenta confiabilidade e reprodutibilidade para ser implementado na avaliação formativa da aprendizagem no estágio.Universidade Federal de Santa MariaBrasilEnfermagemUFSMPrograma de Pós-Graduação em EnfermagemCentro de Ciências da SaúdeCogo, Silvana Bastoshttp://lattes.cnpq.br/9365072653024037Salbego, ClétonFreitas, Etiane de OliveiraPerlini, Nara Marilene Oliveira GirardonAdamy, Edlamar KátiaBackes, Vânia Marli SchubertRamos, Tierle Kosloski2024-05-28T11:19:48Z2024-05-28T11:19:48Z2024-03-15info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisapplication/pdfhttp://repositorio.ufsm.br/handle/1/31928ark:/26339/0013000001m4pporAttribution-NonCommercial-NoDerivatives 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessreponame:Manancial - Repositório Digital da UFSMinstname:Universidade Federal de Santa Maria (UFSM)instacron:UFSM2024-05-28T11:19:48Zoai:repositorio.ufsm.br:1/31928Biblioteca Digital de Teses e Dissertaçõeshttps://repositorio.ufsm.br/ONGhttps://repositorio.ufsm.br/oai/requestatendimento.sib@ufsm.br||tedebc@gmail.comopendoar:2024-05-28T11:19:48Manancial - Repositório Digital da UFSM - Universidade Federal de Santa Maria (UFSM)false
dc.title.none.fl_str_mv Avaliação formativa de estudantes de enfermagem em estágio curricular supervisionado
Formative evaluation of nursing students in supervised curricular internship
title Avaliação formativa de estudantes de enfermagem em estágio curricular supervisionado
spellingShingle Avaliação formativa de estudantes de enfermagem em estágio curricular supervisionado
Ramos, Tierle Kosloski
Enfermagem
Educação em enfermagem
Estágios
Avaliação educacional
Desempenho acadêmico
Nursing
Nursing education
Internships
Educational evaluation
Academic performance
CNPQ::CIENCIAS DA SAUDE::ENFERMAGEM
title_short Avaliação formativa de estudantes de enfermagem em estágio curricular supervisionado
title_full Avaliação formativa de estudantes de enfermagem em estágio curricular supervisionado
title_fullStr Avaliação formativa de estudantes de enfermagem em estágio curricular supervisionado
title_full_unstemmed Avaliação formativa de estudantes de enfermagem em estágio curricular supervisionado
title_sort Avaliação formativa de estudantes de enfermagem em estágio curricular supervisionado
author Ramos, Tierle Kosloski
author_facet Ramos, Tierle Kosloski
author_role author
dc.contributor.none.fl_str_mv Cogo, Silvana Bastos
http://lattes.cnpq.br/9365072653024037
Salbego, Cléton
Freitas, Etiane de Oliveira
Perlini, Nara Marilene Oliveira Girardon
Adamy, Edlamar Kátia
Backes, Vânia Marli Schubert
dc.contributor.author.fl_str_mv Ramos, Tierle Kosloski
dc.subject.por.fl_str_mv Enfermagem
Educação em enfermagem
Estágios
Avaliação educacional
Desempenho acadêmico
Nursing
Nursing education
Internships
Educational evaluation
Academic performance
CNPQ::CIENCIAS DA SAUDE::ENFERMAGEM
topic Enfermagem
Educação em enfermagem
Estágios
Avaliação educacional
Desempenho acadêmico
Nursing
Nursing education
Internships
Educational evaluation
Academic performance
CNPQ::CIENCIAS DA SAUDE::ENFERMAGEM
description The Supervised Curricular Internship provides nursing students with the opportunity to experience everyday situations in the work of nurses, through the acquisition and improvement of skills and competencies that underpin professional practice. In this training context, with regard to learning assessment, it is recommended to use strategies that enable diagnostic, formative and summative assessment. General objective: To develop an instrument for the formative assessment of nursing students in supervised curricular internships. Specific objectives: to develop an Instrument for Formative Assessment of Nursing Students in Supervised Curricular Internships; to validate the content of the instrument with a panel of experts; to evaluate the usability and reliability of the Instrument for Formative Assessment of Nursing Students in Supervised Curricular Internships with the target audience. Method: a methodological, quasi-experimental before-and-after study, carried out in three stages: preparation, validation and evaluation of the instrument, supported by Philippe Perrenoud's theoretical framework of formative assessment. The instrument was developed in January 2023, based on an integrative literature review and official documents from the Ministry of Education and Culture, the Federal Nursing Council and the Brazilian Nursing Association. Validation took place between June and September 2023, using the modified e-Delphi technique. The data was collected online using the Google forms® tool, with the instrument presented in the form of a four-point Likert scale, in which 12 psychometric criteria were assessed. In the first round, 24 experts took part, while in the second round, 12 experts were located through searches on the curriculum lattes platform, institutional websites and snowball sampling. To evaluate the instrument, a quasi-experimental before-and-after study was carried out between October and December 2023 with the target audience (students, supervising nurses and teachers), using the Instrument for Formative Evaluation of Nursing Students in Supervised Curricular Internships. The data was stored in spreadsheets and then analyzed using the Statistical Package for Social Sciences (SPSS)® version 28.0. The reliability and internal consistency of the instrument was analyzed using the Cronbach's alpha coefficient, and the overall validation of the psychometric criteria, as well as the blocks and items of the instrument, was assessed using the Content Validity Index, with CVI ≥ 0.80 being considered adequate. The variables were described by mean and standard deviation and compared between the groups using one-way ANOVA. For the comparison between the domains, ANOVA for repeated measures together with the Bonferroni test was applied. The test and retest results were evaluated using both the Student's t-test for paired samples and the Intraclass Correlation Coefficient. Results: In the first round, 24 experts participated, evaluating the instrument with a CVI of 0.89. In the second round, 12 experts took part, obtaining a final validity index of 0.92 and a reliability of 0.993. In the evaluation with the target audience, there was agreement between the groups on the mean scores of the domains. The instrument proved to be reliable with a Cronbach's alpha of 0.95. In some items, there was low agreement and a significant difference, with no possibility of reproducibility. The domains showed agreement and reproducibility. No sensitivity to change was identified. Conclusion: The instrument was validated by a panel of experts representing all regions of the country, obtaining an adequate evaluation of the items and domains, as well as the other guiding elements, demonstrating that the instrument is valid and reliable. The instrument has the reliability and reproducibility to be implemented in the formative evaluation of internship learning.
publishDate 2024
dc.date.none.fl_str_mv 2024-05-28T11:19:48Z
2024-05-28T11:19:48Z
2024-03-15
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://repositorio.ufsm.br/handle/1/31928
dc.identifier.dark.fl_str_mv ark:/26339/0013000001m4p
url http://repositorio.ufsm.br/handle/1/31928
identifier_str_mv ark:/26339/0013000001m4p
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidade Federal de Santa Maria
Brasil
Enfermagem
UFSM
Programa de Pós-Graduação em Enfermagem
Centro de Ciências da Saúde
publisher.none.fl_str_mv Universidade Federal de Santa Maria
Brasil
Enfermagem
UFSM
Programa de Pós-Graduação em Enfermagem
Centro de Ciências da Saúde
dc.source.none.fl_str_mv reponame:Manancial - Repositório Digital da UFSM
instname:Universidade Federal de Santa Maria (UFSM)
instacron:UFSM
instname_str Universidade Federal de Santa Maria (UFSM)
instacron_str UFSM
institution UFSM
reponame_str Manancial - Repositório Digital da UFSM
collection Manancial - Repositório Digital da UFSM
repository.name.fl_str_mv Manancial - Repositório Digital da UFSM - Universidade Federal de Santa Maria (UFSM)
repository.mail.fl_str_mv atendimento.sib@ufsm.br||tedebc@gmail.com
_version_ 1815172264357789696