Interobserver agreement in using a checklist for the safe administration of enteral nutrition

Detalhes bibliográficos
Autor(a) principal: Silva, Stella Marys Rigatti
Data de Publicação: 2021
Outros Autores: Corrêa, Ana Paula Almeida, Santarem, Michelle Dornelles, Assis, Michelli Cristina Silva de, Beghetto, Mariur Gomes
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Institucional da UFRGS
Texto Completo: http://hdl.handle.net/10183/231783
Resumo: Objective: to describe an evaluation of interobserver agreement in the use of a checklist related to the use of nasoenteral tube (NSS) as a presupposition for quality in obtaining data. Method: a methodological study conducted in 2018 in a Brazilian hospital, preceding the data collection of an open-label clinical trial. Independent observers, blinded to the evaluation of their peers, evaluated patients with NSS through a 25-item checklist. The data collected by eight previously trained research assistants (RA) were compared to those obtained by an experienced nurse (reference standard). Agreement was measured using the kappa coefficient and PABAK. Results: a total of 451 observations were made in pairs. Considering the total items on the checklist there was almost perfect agreement (k > 0.80) in all observation pairs (nurse vs. each RA): RA 1 (k = 0.91; 95 % CI = 0.89-0.93); RA 2 (k = 0.83; 95 % CI = 0.80-0.85); AP 3 (k = 0.92; 95 % CI = 0.90-0.94); RA 4 (k = 0.83; 95 % CI = 0.80-0.86); RA 5 (k = 0.94; 95 % CI = 0.92-0.96); RA 6 (k = 0.94; 95 % CI = 0.92- 0.96); RA 7 (k = 0.96; 95 % CI = 0.95-0.98); RA 8 (k = 0.73; 95 % CI = 0.70-0.77). However, for isolated items, and in specific RAs, there were fair agreements, unacceptable to effectively collect data from a clinical trial. Retraining and supervision of RAs were able to improve agreement between observers. Conclusion: an evaluation of interobserver agreement proved to be fundamental to ensure the reliability of data collection and, therefore, to avoid measurement biases.
id UFRGS-2_f63c4f1b9f835fa6fe2a7ef69463eb62
oai_identifier_str oai:www.lume.ufrgs.br:10183/231783
network_acronym_str UFRGS-2
network_name_str Repositório Institucional da UFRGS
repository_id_str
spelling Silva, Stella Marys RigattiCorrêa, Ana Paula AlmeidaSantarem, Michelle DornellesAssis, Michelli Cristina Silva deBeghetto, Mariur Gomes2021-11-13T04:46:21Z20211699-5198http://hdl.handle.net/10183/231783001131572Objective: to describe an evaluation of interobserver agreement in the use of a checklist related to the use of nasoenteral tube (NSS) as a presupposition for quality in obtaining data. Method: a methodological study conducted in 2018 in a Brazilian hospital, preceding the data collection of an open-label clinical trial. Independent observers, blinded to the evaluation of their peers, evaluated patients with NSS through a 25-item checklist. The data collected by eight previously trained research assistants (RA) were compared to those obtained by an experienced nurse (reference standard). Agreement was measured using the kappa coefficient and PABAK. Results: a total of 451 observations were made in pairs. Considering the total items on the checklist there was almost perfect agreement (k > 0.80) in all observation pairs (nurse vs. each RA): RA 1 (k = 0.91; 95 % CI = 0.89-0.93); RA 2 (k = 0.83; 95 % CI = 0.80-0.85); AP 3 (k = 0.92; 95 % CI = 0.90-0.94); RA 4 (k = 0.83; 95 % CI = 0.80-0.86); RA 5 (k = 0.94; 95 % CI = 0.92-0.96); RA 6 (k = 0.94; 95 % CI = 0.92- 0.96); RA 7 (k = 0.96; 95 % CI = 0.95-0.98); RA 8 (k = 0.73; 95 % CI = 0.70-0.77). However, for isolated items, and in specific RAs, there were fair agreements, unacceptable to effectively collect data from a clinical trial. Retraining and supervision of RAs were able to improve agreement between observers. Conclusion: an evaluation of interobserver agreement proved to be fundamental to ensure the reliability of data collection and, therefore, to avoid measurement biases.Objetivo: describir una evaluación de la concordancia entre observadores en el uso de una lista de control en la atención a pacientes con sonda nasoenteral (SNE) como premisa de la recogida de datos. Método: este estudio de fiabilidad se realizó en 2018 en un hospital brasileño, antes de la recogida de datos para un ensayo clínico abierto. Ocho observadores independientes, previamente capacitados y “cegados” con respecto a las evaluaciones de los demás, evaluaron a pacientes con SNE por medio de una lista de comprobación de 25 elementos. Los datos obtenidos por estos asistentes de investigación (AI) se compararon con los obtenidos por una enfermera experimentada. Se midió la concordancia mediante los coeficientes kappa y PABAK. Resultados: se realizaron 451 observaciones por pares. Considerando la totalidad de los elementos, hubo una concordancia casi perfecta (k > 0,80) en todos los pares de observación (enfermera vs. cada AI): AI 1 (k = 0,91; IC95 % = 0,89-0,93); AI 2 (k = 0,83; IC95 % = 0,80-0,85); AI 3 (k = 0,92; IC95 %= 0,90-0,94 ); AI 4 (k = 0,83; IC95 % = 0,80-0,86); AI 5 (k = 0,94; IC95 % = 0,92-0,96); AI 6 (k = 0,94; IC95 % = 0,92-0,96); AI 7 (k = 0,96; IC95 % = 0,95-0,98); AI 8 (k = 0,73; IC95 % = 0,70-0,77). Se identificó un menor número de concordancia en los elementos individuales y en determinados AI. La recapacitación y supervisión de los AI mejoró su desempeño y la concordancia entre observadores. Conclusión: la evaluación de la concordancia entre observadores resultó fundamental para asegurar la fiabilidad de la recogida de datos y, por consiguiente, evitar sesgos de medición en los estudios clínicos de enfermería.application/pdfengNutrición hospitalaria. Madrid. Vol. 38, n.5 (2021), p. 903-910Confiabilidade dos dadosVariações dependentes do observadorNutrição enteralCuidados de enfermagemData accuracyObserver variationEnteral nutritionNursing careExactitud de los datosVariaciones dependientes del observadorNutrición enteralAtención de enfermeríaInterobserver agreement in using a checklist for the safe administration of enteral nutritionConcordancia entre observadores en la aplicación de la lista de control para la administración segura de la nutrición enteral Estrangeiroinfo:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/openAccessreponame:Repositório Institucional da UFRGSinstname:Universidade Federal do Rio Grande do Sul (UFRGS)instacron:UFRGSTEXT001131572.pdf.txt001131572.pdf.txtExtracted Texttext/plain35698http://www.lume.ufrgs.br/bitstream/10183/231783/2/001131572.pdf.txt99cb52dc61bcb47b9539c2d2a3e5b000MD52ORIGINAL001131572.pdfTexto completo (espanhol)application/pdf725100http://www.lume.ufrgs.br/bitstream/10183/231783/1/001131572.pdfee2cb5f7f4400c95f95c9c78c632666dMD5110183/2317832021-11-20 06:21:42.84198oai:www.lume.ufrgs.br:10183/231783Repositório de PublicaçõesPUBhttps://lume.ufrgs.br/oai/requestopendoar:2021-11-20T08:21:42Repositório Institucional da UFRGS - Universidade Federal do Rio Grande do Sul (UFRGS)false
dc.title.pt_BR.fl_str_mv Interobserver agreement in using a checklist for the safe administration of enteral nutrition
dc.title.alternative.es.fl_str_mv Concordancia entre observadores en la aplicación de la lista de control para la administración segura de la nutrición enteral
title Interobserver agreement in using a checklist for the safe administration of enteral nutrition
spellingShingle Interobserver agreement in using a checklist for the safe administration of enteral nutrition
Silva, Stella Marys Rigatti
Confiabilidade dos dados
Variações dependentes do observador
Nutrição enteral
Cuidados de enfermagem
Data accuracy
Observer variation
Enteral nutrition
Nursing care
Exactitud de los datos
Variaciones dependientes del observador
Nutrición enteral
Atención de enfermería
title_short Interobserver agreement in using a checklist for the safe administration of enteral nutrition
title_full Interobserver agreement in using a checklist for the safe administration of enteral nutrition
title_fullStr Interobserver agreement in using a checklist for the safe administration of enteral nutrition
title_full_unstemmed Interobserver agreement in using a checklist for the safe administration of enteral nutrition
title_sort Interobserver agreement in using a checklist for the safe administration of enteral nutrition
author Silva, Stella Marys Rigatti
author_facet Silva, Stella Marys Rigatti
Corrêa, Ana Paula Almeida
Santarem, Michelle Dornelles
Assis, Michelli Cristina Silva de
Beghetto, Mariur Gomes
author_role author
author2 Corrêa, Ana Paula Almeida
Santarem, Michelle Dornelles
Assis, Michelli Cristina Silva de
Beghetto, Mariur Gomes
author2_role author
author
author
author
dc.contributor.author.fl_str_mv Silva, Stella Marys Rigatti
Corrêa, Ana Paula Almeida
Santarem, Michelle Dornelles
Assis, Michelli Cristina Silva de
Beghetto, Mariur Gomes
dc.subject.por.fl_str_mv Confiabilidade dos dados
Variações dependentes do observador
Nutrição enteral
Cuidados de enfermagem
topic Confiabilidade dos dados
Variações dependentes do observador
Nutrição enteral
Cuidados de enfermagem
Data accuracy
Observer variation
Enteral nutrition
Nursing care
Exactitud de los datos
Variaciones dependientes del observador
Nutrición enteral
Atención de enfermería
dc.subject.eng.fl_str_mv Data accuracy
Observer variation
Enteral nutrition
Nursing care
dc.subject.spa.fl_str_mv Exactitud de los datos
Variaciones dependientes del observador
Nutrición enteral
Atención de enfermería
description Objective: to describe an evaluation of interobserver agreement in the use of a checklist related to the use of nasoenteral tube (NSS) as a presupposition for quality in obtaining data. Method: a methodological study conducted in 2018 in a Brazilian hospital, preceding the data collection of an open-label clinical trial. Independent observers, blinded to the evaluation of their peers, evaluated patients with NSS through a 25-item checklist. The data collected by eight previously trained research assistants (RA) were compared to those obtained by an experienced nurse (reference standard). Agreement was measured using the kappa coefficient and PABAK. Results: a total of 451 observations were made in pairs. Considering the total items on the checklist there was almost perfect agreement (k > 0.80) in all observation pairs (nurse vs. each RA): RA 1 (k = 0.91; 95 % CI = 0.89-0.93); RA 2 (k = 0.83; 95 % CI = 0.80-0.85); AP 3 (k = 0.92; 95 % CI = 0.90-0.94); RA 4 (k = 0.83; 95 % CI = 0.80-0.86); RA 5 (k = 0.94; 95 % CI = 0.92-0.96); RA 6 (k = 0.94; 95 % CI = 0.92- 0.96); RA 7 (k = 0.96; 95 % CI = 0.95-0.98); RA 8 (k = 0.73; 95 % CI = 0.70-0.77). However, for isolated items, and in specific RAs, there were fair agreements, unacceptable to effectively collect data from a clinical trial. Retraining and supervision of RAs were able to improve agreement between observers. Conclusion: an evaluation of interobserver agreement proved to be fundamental to ensure the reliability of data collection and, therefore, to avoid measurement biases.
publishDate 2021
dc.date.accessioned.fl_str_mv 2021-11-13T04:46:21Z
dc.date.issued.fl_str_mv 2021
dc.type.driver.fl_str_mv Estrangeiro
info:eu-repo/semantics/article
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10183/231783
dc.identifier.issn.pt_BR.fl_str_mv 1699-5198
dc.identifier.nrb.pt_BR.fl_str_mv 001131572
identifier_str_mv 1699-5198
001131572
url http://hdl.handle.net/10183/231783
dc.language.iso.fl_str_mv eng
language eng
dc.relation.ispartof.pt_BR.fl_str_mv Nutrición hospitalaria. Madrid. Vol. 38, n.5 (2021), p. 903-910
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFRGS
instname:Universidade Federal do Rio Grande do Sul (UFRGS)
instacron:UFRGS
instname_str Universidade Federal do Rio Grande do Sul (UFRGS)
instacron_str UFRGS
institution UFRGS
reponame_str Repositório Institucional da UFRGS
collection Repositório Institucional da UFRGS
bitstream.url.fl_str_mv http://www.lume.ufrgs.br/bitstream/10183/231783/2/001131572.pdf.txt
http://www.lume.ufrgs.br/bitstream/10183/231783/1/001131572.pdf
bitstream.checksum.fl_str_mv 99cb52dc61bcb47b9539c2d2a3e5b000
ee2cb5f7f4400c95f95c9c78c632666d
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFRGS - Universidade Federal do Rio Grande do Sul (UFRGS)
repository.mail.fl_str_mv
_version_ 1801225042266161152