Collecting Valid and Reliable Data: Fieldwork Monitoring Strategies in a Health Examination Survey

Detalhes bibliográficos
Autor(a) principal: Kislaya, Irina
Data de Publicação: 2020
Outros Autores: Santos, Ana João, Lyshol, Heidi, Antunes, Liliana, Barreto, Marta, Gaio, Vânia, Gil, Ana Paula, Namorado, Sónia, Matias Dias, Carlos , Tolonen, Hanna, Nunes, Baltazar
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10400.18/7513
Resumo: Introduction: Health surveys constitute a relevant information source to access the population’s health status. Given that survey errors can significantly influence estimates and invalidate study findings, it is crucial that the fieldwork progress is closely monitored to ensure data quality. The objective of this study was to describe the fieldwork monitoring conducted during the first Portuguese National Health Examination Survey (INSEF) regarding protocol deviations and key performance indicators (KPI). Methods: Data derived from interviewer observation and from the statistical quality control of selected KPI were used to monitor the four components of the INSEF survey (recruitment, physical examination, blood collection and health questionnaire). Survey KPI included response rate, average time distribution for procedures, distribution of the last digit in a specific measure, proportion of haemolysed blood samples and missing values. Results: Interviewer observation identified deviations from the established protocols, which were promptly corrected. During fieldwork monitoring through KPI, upon implementation of corrective measures, the participation rate increased 2.5-fold, and a 4.4-fold decrease in non-adherence to standardized survey procedures was observed in the average time distribution for blood pressure measurement. The proportion of measurements with the terminal digit of 0 or 5 decreased to 19.6 and 16.5%, respectively, after the pilot study. The proportion of haemolysed samples was at baseline level, below 2.5%. Missing data issues were minimized by promptly communicating them to the interviewer, who could recontact the participant and fill in the missing information. Discussion/Conclusion: Although the majority of the deviations from the established protocol occurred during the first weeks of the fieldwork, our results emphasize the importance of continuous monitoring of survey KPI to ensure data quality throughout the survey.
id RCAP_8dafc931adaf0bf4f3ad9d453b32a98d
oai_identifier_str oai:repositorio.insa.pt:10400.18/7513
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Collecting Valid and Reliable Data: Fieldwork Monitoring Strategies in a Health Examination SurveyRecolha de informação válida e credível em saúde: estratégias de monitorização do trabalho de campo num inquérito com exame físicoHealth InformationHealth Examination SurveyData QualityFieldwork MonitoringInformação em SaúdeInquérito Nacional de Saúde com Exame FísicoINSEFQualidade dos DadosObservação do Entrevistador ·Monitorização da Recolha de DadosDeterminantes da Saúde e da DoençaIntroduction: Health surveys constitute a relevant information source to access the population’s health status. Given that survey errors can significantly influence estimates and invalidate study findings, it is crucial that the fieldwork progress is closely monitored to ensure data quality. The objective of this study was to describe the fieldwork monitoring conducted during the first Portuguese National Health Examination Survey (INSEF) regarding protocol deviations and key performance indicators (KPI). Methods: Data derived from interviewer observation and from the statistical quality control of selected KPI were used to monitor the four components of the INSEF survey (recruitment, physical examination, blood collection and health questionnaire). Survey KPI included response rate, average time distribution for procedures, distribution of the last digit in a specific measure, proportion of haemolysed blood samples and missing values. Results: Interviewer observation identified deviations from the established protocols, which were promptly corrected. During fieldwork monitoring through KPI, upon implementation of corrective measures, the participation rate increased 2.5-fold, and a 4.4-fold decrease in non-adherence to standardized survey procedures was observed in the average time distribution for blood pressure measurement. The proportion of measurements with the terminal digit of 0 or 5 decreased to 19.6 and 16.5%, respectively, after the pilot study. The proportion of haemolysed samples was at baseline level, below 2.5%. Missing data issues were minimized by promptly communicating them to the interviewer, who could recontact the participant and fill in the missing information. Discussion/Conclusion: Although the majority of the deviations from the established protocol occurred during the first weeks of the fieldwork, our results emphasize the importance of continuous monitoring of survey KPI to ensure data quality throughout the survey.Introdução: Os inquéritos de saúde constituem uma importante fonte de informação para conhecer o estado de saúde da população. Visto que os erros associados aos inquéritos podem afetar significativamente as estimativas, invalidando as suas conclusões, é crucial monitorizar o progresso do trabalho de campo. Este estudo teve como objetivo descrever a monitorização do trabalho de campo realizado durante o primeiro Inquérito Nacional de Saúde com Exame Físico (INSEF) referente a desvios ao protocolo e principais indicadores de desempenho (KPI). Métodos: Dados resultantes da observação dos entrevistadores e do controlo estatístico de qualidade de alguns dos KPI foram utilizados para monitorizar as quatro componentes do inquérito (recrutamento, exame físico; colheita de sangue e questionário de saúde), durante a implementação do trabalho de campo. Os KPI selecionados incluíram a taxa de resposta, distribuição do tempo médio de realização dos procedimentos, proporção do último dígito para medidas específicas, proporção de amostras de sangue hemolisadas e dos valores omissos. Resultados: A observação dos entrevistadores permitiu identificar e corrigir atempadamente desvios ao protocolo. Após a implementação de medidas corretivas, com base na monitorização dos KPI, a taxa de participação aumentou 2,5 vezes e foi observada uma redução de 4,4 vezes na não adesão aos procedimentos padronizados para a medição da pressão arterial. Após o estudo piloto, a proporção de medições com o dígito terminal de 0 ou 5 diminuiu para 19,6% e 16,5%, respectivamente. A proporção de amostras hemolisadas foi inferior a 2,5%. A proporção dos valores omissos foi minimizada comunicando-os imediatamente ao entrevistador, que poderia recontactar o participante e completar a informação. Discussão/Conclusão: Embora a maioria dos desvios ao protocolo tenha ocorrido durante as primeiras semanas do trabalho de campo, os resultados mostram a importância da sua monitorização continua nos inquéritos de saúde de forma a garantir a qualidade dos dados recolhidos.INSEF was developed as part of the predefined project of the Public Health Initiatives Program, “Improvement of Epidemiological Health Information to Support Public Health Decision and Management in Portugal. Towards Reduced Inequalities, Improved Health, and Bilateral Cooperation,” that benefited from a EUR 1,500,000 grant from Iceland, Liechtenstein and Norway through the EEA Grants and the Portuguese government.Karger PublishersRepositório Científico do Instituto Nacional de SaúdeKislaya, IrinaSantos, Ana JoãoLyshol, HeidiAntunes, LilianaBarreto, MartaGaio, VâniaGil, Ana PaulaNamorado, SóniaMatias Dias, Carlos Tolonen, HannaNunes, Baltazar2021-03-16T18:41:33Z2020-12-142020-12-14T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10400.18/7513engPort J Public Health 2021 jan;38(2):81-90. doi: 10.1159/000511576. Epub 2020 dec 142504-313710.1159/0005115762504-3145info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-07-20T15:41:55Zoai:repositorio.insa.pt:10400.18/7513Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T18:41:57.634187Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Collecting Valid and Reliable Data: Fieldwork Monitoring Strategies in a Health Examination Survey
Recolha de informação válida e credível em saúde: estratégias de monitorização do trabalho de campo num inquérito com exame físico
title Collecting Valid and Reliable Data: Fieldwork Monitoring Strategies in a Health Examination Survey
spellingShingle Collecting Valid and Reliable Data: Fieldwork Monitoring Strategies in a Health Examination Survey
Kislaya, Irina
Health Information
Health Examination Survey
Data Quality
Fieldwork Monitoring
Informação em Saúde
Inquérito Nacional de Saúde com Exame Físico
INSEF
Qualidade dos Dados
Observação do Entrevistador ·
Monitorização da Recolha de Dados
Determinantes da Saúde e da Doença
title_short Collecting Valid and Reliable Data: Fieldwork Monitoring Strategies in a Health Examination Survey
title_full Collecting Valid and Reliable Data: Fieldwork Monitoring Strategies in a Health Examination Survey
title_fullStr Collecting Valid and Reliable Data: Fieldwork Monitoring Strategies in a Health Examination Survey
title_full_unstemmed Collecting Valid and Reliable Data: Fieldwork Monitoring Strategies in a Health Examination Survey
title_sort Collecting Valid and Reliable Data: Fieldwork Monitoring Strategies in a Health Examination Survey
author Kislaya, Irina
author_facet Kislaya, Irina
Santos, Ana João
Lyshol, Heidi
Antunes, Liliana
Barreto, Marta
Gaio, Vânia
Gil, Ana Paula
Namorado, Sónia
Matias Dias, Carlos 
Tolonen, Hanna
Nunes, Baltazar
author_role author
author2 Santos, Ana João
Lyshol, Heidi
Antunes, Liliana
Barreto, Marta
Gaio, Vânia
Gil, Ana Paula
Namorado, Sónia
Matias Dias, Carlos 
Tolonen, Hanna
Nunes, Baltazar
author2_role author
author
author
author
author
author
author
author
author
author
dc.contributor.none.fl_str_mv Repositório Científico do Instituto Nacional de Saúde
dc.contributor.author.fl_str_mv Kislaya, Irina
Santos, Ana João
Lyshol, Heidi
Antunes, Liliana
Barreto, Marta
Gaio, Vânia
Gil, Ana Paula
Namorado, Sónia
Matias Dias, Carlos 
Tolonen, Hanna
Nunes, Baltazar
dc.subject.por.fl_str_mv Health Information
Health Examination Survey
Data Quality
Fieldwork Monitoring
Informação em Saúde
Inquérito Nacional de Saúde com Exame Físico
INSEF
Qualidade dos Dados
Observação do Entrevistador ·
Monitorização da Recolha de Dados
Determinantes da Saúde e da Doença
topic Health Information
Health Examination Survey
Data Quality
Fieldwork Monitoring
Informação em Saúde
Inquérito Nacional de Saúde com Exame Físico
INSEF
Qualidade dos Dados
Observação do Entrevistador ·
Monitorização da Recolha de Dados
Determinantes da Saúde e da Doença
description Introduction: Health surveys constitute a relevant information source to access the population’s health status. Given that survey errors can significantly influence estimates and invalidate study findings, it is crucial that the fieldwork progress is closely monitored to ensure data quality. The objective of this study was to describe the fieldwork monitoring conducted during the first Portuguese National Health Examination Survey (INSEF) regarding protocol deviations and key performance indicators (KPI). Methods: Data derived from interviewer observation and from the statistical quality control of selected KPI were used to monitor the four components of the INSEF survey (recruitment, physical examination, blood collection and health questionnaire). Survey KPI included response rate, average time distribution for procedures, distribution of the last digit in a specific measure, proportion of haemolysed blood samples and missing values. Results: Interviewer observation identified deviations from the established protocols, which were promptly corrected. During fieldwork monitoring through KPI, upon implementation of corrective measures, the participation rate increased 2.5-fold, and a 4.4-fold decrease in non-adherence to standardized survey procedures was observed in the average time distribution for blood pressure measurement. The proportion of measurements with the terminal digit of 0 or 5 decreased to 19.6 and 16.5%, respectively, after the pilot study. The proportion of haemolysed samples was at baseline level, below 2.5%. Missing data issues were minimized by promptly communicating them to the interviewer, who could recontact the participant and fill in the missing information. Discussion/Conclusion: Although the majority of the deviations from the established protocol occurred during the first weeks of the fieldwork, our results emphasize the importance of continuous monitoring of survey KPI to ensure data quality throughout the survey.
publishDate 2020
dc.date.none.fl_str_mv 2020-12-14
2020-12-14T00:00:00Z
2021-03-16T18:41:33Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10400.18/7513
url http://hdl.handle.net/10400.18/7513
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Port J Public Health 2021 jan;38(2):81-90. doi: 10.1159/000511576. Epub 2020 dec 14
2504-3137
10.1159/000511576
2504-3145
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Karger Publishers
publisher.none.fl_str_mv Karger Publishers
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799132163870818304