Interobserver agreement in using a checklist for the safe administration of enteral nutrition
Autor(a) principal: | |
---|---|
Data de Publicação: | 2021 |
Outros Autores: | , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Institucional da UFRGS |
Texto Completo: | http://hdl.handle.net/10183/231783 |
Resumo: | Objective: to describe an evaluation of interobserver agreement in the use of a checklist related to the use of nasoenteral tube (NSS) as a presupposition for quality in obtaining data. Method: a methodological study conducted in 2018 in a Brazilian hospital, preceding the data collection of an open-label clinical trial. Independent observers, blinded to the evaluation of their peers, evaluated patients with NSS through a 25-item checklist. The data collected by eight previously trained research assistants (RA) were compared to those obtained by an experienced nurse (reference standard). Agreement was measured using the kappa coefficient and PABAK. Results: a total of 451 observations were made in pairs. Considering the total items on the checklist there was almost perfect agreement (k > 0.80) in all observation pairs (nurse vs. each RA): RA 1 (k = 0.91; 95 % CI = 0.89-0.93); RA 2 (k = 0.83; 95 % CI = 0.80-0.85); AP 3 (k = 0.92; 95 % CI = 0.90-0.94); RA 4 (k = 0.83; 95 % CI = 0.80-0.86); RA 5 (k = 0.94; 95 % CI = 0.92-0.96); RA 6 (k = 0.94; 95 % CI = 0.92- 0.96); RA 7 (k = 0.96; 95 % CI = 0.95-0.98); RA 8 (k = 0.73; 95 % CI = 0.70-0.77). However, for isolated items, and in specific RAs, there were fair agreements, unacceptable to effectively collect data from a clinical trial. Retraining and supervision of RAs were able to improve agreement between observers. Conclusion: an evaluation of interobserver agreement proved to be fundamental to ensure the reliability of data collection and, therefore, to avoid measurement biases. |
id |
UFRGS-2_f63c4f1b9f835fa6fe2a7ef69463eb62 |
---|---|
oai_identifier_str |
oai:www.lume.ufrgs.br:10183/231783 |
network_acronym_str |
UFRGS-2 |
network_name_str |
Repositório Institucional da UFRGS |
repository_id_str |
|
spelling |
Silva, Stella Marys RigattiCorrêa, Ana Paula AlmeidaSantarem, Michelle DornellesAssis, Michelli Cristina Silva deBeghetto, Mariur Gomes2021-11-13T04:46:21Z20211699-5198http://hdl.handle.net/10183/231783001131572Objective: to describe an evaluation of interobserver agreement in the use of a checklist related to the use of nasoenteral tube (NSS) as a presupposition for quality in obtaining data. Method: a methodological study conducted in 2018 in a Brazilian hospital, preceding the data collection of an open-label clinical trial. Independent observers, blinded to the evaluation of their peers, evaluated patients with NSS through a 25-item checklist. The data collected by eight previously trained research assistants (RA) were compared to those obtained by an experienced nurse (reference standard). Agreement was measured using the kappa coefficient and PABAK. Results: a total of 451 observations were made in pairs. Considering the total items on the checklist there was almost perfect agreement (k > 0.80) in all observation pairs (nurse vs. each RA): RA 1 (k = 0.91; 95 % CI = 0.89-0.93); RA 2 (k = 0.83; 95 % CI = 0.80-0.85); AP 3 (k = 0.92; 95 % CI = 0.90-0.94); RA 4 (k = 0.83; 95 % CI = 0.80-0.86); RA 5 (k = 0.94; 95 % CI = 0.92-0.96); RA 6 (k = 0.94; 95 % CI = 0.92- 0.96); RA 7 (k = 0.96; 95 % CI = 0.95-0.98); RA 8 (k = 0.73; 95 % CI = 0.70-0.77). However, for isolated items, and in specific RAs, there were fair agreements, unacceptable to effectively collect data from a clinical trial. Retraining and supervision of RAs were able to improve agreement between observers. Conclusion: an evaluation of interobserver agreement proved to be fundamental to ensure the reliability of data collection and, therefore, to avoid measurement biases.Objetivo: describir una evaluación de la concordancia entre observadores en el uso de una lista de control en la atención a pacientes con sonda nasoenteral (SNE) como premisa de la recogida de datos. Método: este estudio de fiabilidad se realizó en 2018 en un hospital brasileño, antes de la recogida de datos para un ensayo clínico abierto. Ocho observadores independientes, previamente capacitados y “cegados” con respecto a las evaluaciones de los demás, evaluaron a pacientes con SNE por medio de una lista de comprobación de 25 elementos. Los datos obtenidos por estos asistentes de investigación (AI) se compararon con los obtenidos por una enfermera experimentada. Se midió la concordancia mediante los coeficientes kappa y PABAK. Resultados: se realizaron 451 observaciones por pares. Considerando la totalidad de los elementos, hubo una concordancia casi perfecta (k > 0,80) en todos los pares de observación (enfermera vs. cada AI): AI 1 (k = 0,91; IC95 % = 0,89-0,93); AI 2 (k = 0,83; IC95 % = 0,80-0,85); AI 3 (k = 0,92; IC95 %= 0,90-0,94 ); AI 4 (k = 0,83; IC95 % = 0,80-0,86); AI 5 (k = 0,94; IC95 % = 0,92-0,96); AI 6 (k = 0,94; IC95 % = 0,92-0,96); AI 7 (k = 0,96; IC95 % = 0,95-0,98); AI 8 (k = 0,73; IC95 % = 0,70-0,77). Se identificó un menor número de concordancia en los elementos individuales y en determinados AI. La recapacitación y supervisión de los AI mejoró su desempeño y la concordancia entre observadores. Conclusión: la evaluación de la concordancia entre observadores resultó fundamental para asegurar la fiabilidad de la recogida de datos y, por consiguiente, evitar sesgos de medición en los estudios clínicos de enfermería.application/pdfengNutrición hospitalaria. Madrid. Vol. 38, n.5 (2021), p. 903-910Confiabilidade dos dadosVariações dependentes do observadorNutrição enteralCuidados de enfermagemData accuracyObserver variationEnteral nutritionNursing careExactitud de los datosVariaciones dependientes del observadorNutrición enteralAtención de enfermeríaInterobserver agreement in using a checklist for the safe administration of enteral nutritionConcordancia entre observadores en la aplicación de la lista de control para la administración segura de la nutrición enteral Estrangeiroinfo:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/openAccessreponame:Repositório Institucional da UFRGSinstname:Universidade Federal do Rio Grande do Sul (UFRGS)instacron:UFRGSTEXT001131572.pdf.txt001131572.pdf.txtExtracted Texttext/plain35698http://www.lume.ufrgs.br/bitstream/10183/231783/2/001131572.pdf.txt99cb52dc61bcb47b9539c2d2a3e5b000MD52ORIGINAL001131572.pdfTexto completo (espanhol)application/pdf725100http://www.lume.ufrgs.br/bitstream/10183/231783/1/001131572.pdfee2cb5f7f4400c95f95c9c78c632666dMD5110183/2317832021-11-20 06:21:42.84198oai:www.lume.ufrgs.br:10183/231783Repositório de PublicaçõesPUBhttps://lume.ufrgs.br/oai/requestopendoar:2021-11-20T08:21:42Repositório Institucional da UFRGS - Universidade Federal do Rio Grande do Sul (UFRGS)false |
dc.title.pt_BR.fl_str_mv |
Interobserver agreement in using a checklist for the safe administration of enteral nutrition |
dc.title.alternative.es.fl_str_mv |
Concordancia entre observadores en la aplicación de la lista de control para la administración segura de la nutrición enteral |
title |
Interobserver agreement in using a checklist for the safe administration of enteral nutrition |
spellingShingle |
Interobserver agreement in using a checklist for the safe administration of enteral nutrition Silva, Stella Marys Rigatti Confiabilidade dos dados Variações dependentes do observador Nutrição enteral Cuidados de enfermagem Data accuracy Observer variation Enteral nutrition Nursing care Exactitud de los datos Variaciones dependientes del observador Nutrición enteral Atención de enfermería |
title_short |
Interobserver agreement in using a checklist for the safe administration of enteral nutrition |
title_full |
Interobserver agreement in using a checklist for the safe administration of enteral nutrition |
title_fullStr |
Interobserver agreement in using a checklist for the safe administration of enteral nutrition |
title_full_unstemmed |
Interobserver agreement in using a checklist for the safe administration of enteral nutrition |
title_sort |
Interobserver agreement in using a checklist for the safe administration of enteral nutrition |
author |
Silva, Stella Marys Rigatti |
author_facet |
Silva, Stella Marys Rigatti Corrêa, Ana Paula Almeida Santarem, Michelle Dornelles Assis, Michelli Cristina Silva de Beghetto, Mariur Gomes |
author_role |
author |
author2 |
Corrêa, Ana Paula Almeida Santarem, Michelle Dornelles Assis, Michelli Cristina Silva de Beghetto, Mariur Gomes |
author2_role |
author author author author |
dc.contributor.author.fl_str_mv |
Silva, Stella Marys Rigatti Corrêa, Ana Paula Almeida Santarem, Michelle Dornelles Assis, Michelli Cristina Silva de Beghetto, Mariur Gomes |
dc.subject.por.fl_str_mv |
Confiabilidade dos dados Variações dependentes do observador Nutrição enteral Cuidados de enfermagem |
topic |
Confiabilidade dos dados Variações dependentes do observador Nutrição enteral Cuidados de enfermagem Data accuracy Observer variation Enteral nutrition Nursing care Exactitud de los datos Variaciones dependientes del observador Nutrición enteral Atención de enfermería |
dc.subject.eng.fl_str_mv |
Data accuracy Observer variation Enteral nutrition Nursing care |
dc.subject.spa.fl_str_mv |
Exactitud de los datos Variaciones dependientes del observador Nutrición enteral Atención de enfermería |
description |
Objective: to describe an evaluation of interobserver agreement in the use of a checklist related to the use of nasoenteral tube (NSS) as a presupposition for quality in obtaining data. Method: a methodological study conducted in 2018 in a Brazilian hospital, preceding the data collection of an open-label clinical trial. Independent observers, blinded to the evaluation of their peers, evaluated patients with NSS through a 25-item checklist. The data collected by eight previously trained research assistants (RA) were compared to those obtained by an experienced nurse (reference standard). Agreement was measured using the kappa coefficient and PABAK. Results: a total of 451 observations were made in pairs. Considering the total items on the checklist there was almost perfect agreement (k > 0.80) in all observation pairs (nurse vs. each RA): RA 1 (k = 0.91; 95 % CI = 0.89-0.93); RA 2 (k = 0.83; 95 % CI = 0.80-0.85); AP 3 (k = 0.92; 95 % CI = 0.90-0.94); RA 4 (k = 0.83; 95 % CI = 0.80-0.86); RA 5 (k = 0.94; 95 % CI = 0.92-0.96); RA 6 (k = 0.94; 95 % CI = 0.92- 0.96); RA 7 (k = 0.96; 95 % CI = 0.95-0.98); RA 8 (k = 0.73; 95 % CI = 0.70-0.77). However, for isolated items, and in specific RAs, there were fair agreements, unacceptable to effectively collect data from a clinical trial. Retraining and supervision of RAs were able to improve agreement between observers. Conclusion: an evaluation of interobserver agreement proved to be fundamental to ensure the reliability of data collection and, therefore, to avoid measurement biases. |
publishDate |
2021 |
dc.date.accessioned.fl_str_mv |
2021-11-13T04:46:21Z |
dc.date.issued.fl_str_mv |
2021 |
dc.type.driver.fl_str_mv |
Estrangeiro info:eu-repo/semantics/article |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://hdl.handle.net/10183/231783 |
dc.identifier.issn.pt_BR.fl_str_mv |
1699-5198 |
dc.identifier.nrb.pt_BR.fl_str_mv |
001131572 |
identifier_str_mv |
1699-5198 001131572 |
url |
http://hdl.handle.net/10183/231783 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.ispartof.pt_BR.fl_str_mv |
Nutrición hospitalaria. Madrid. Vol. 38, n.5 (2021), p. 903-910 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.source.none.fl_str_mv |
reponame:Repositório Institucional da UFRGS instname:Universidade Federal do Rio Grande do Sul (UFRGS) instacron:UFRGS |
instname_str |
Universidade Federal do Rio Grande do Sul (UFRGS) |
instacron_str |
UFRGS |
institution |
UFRGS |
reponame_str |
Repositório Institucional da UFRGS |
collection |
Repositório Institucional da UFRGS |
bitstream.url.fl_str_mv |
http://www.lume.ufrgs.br/bitstream/10183/231783/2/001131572.pdf.txt http://www.lume.ufrgs.br/bitstream/10183/231783/1/001131572.pdf |
bitstream.checksum.fl_str_mv |
99cb52dc61bcb47b9539c2d2a3e5b000 ee2cb5f7f4400c95f95c9c78c632666d |
bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 |
repository.name.fl_str_mv |
Repositório Institucional da UFRGS - Universidade Federal do Rio Grande do Sul (UFRGS) |
repository.mail.fl_str_mv |
|
_version_ |
1815447774089445376 |