Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales

Detalhes bibliográficos
Autor(a) principal: Meira, Marcela Antunes
Data de Publicação: 2021
Tipo de documento: Dissertação
Idioma: por
Título da fonte: Biblioteca Digital de Teses e Dissertações da UFPB
Texto Completo: https://repositorio.ufpb.br/jspui/handle/123456789/23143
Resumo: There has been an increase on the intensity of rainfall extreme events. These events have high contribution on hazards in urban areas, such as flash flooding, landslides and excessive erosion, which leads to social, economic and environmental damage. Sub-hourly rainfall information has a critical role in the assessment of such natural disasters, however, the monitoring networks in developing countries still lack High-Quality data. Therefore, this study aims to present a new quality control procedure for sub-hourly rainfall data in Brazil, analyzing 7 years (2014-2020) of tipping bucket rain gauge data, in a sub-hourly scale, from CEMADEN’s (Brazilian National Centre for Monitoring and Early Warnings of Natural Disasters) rain gauges network. The proposed method is made separately each year through a series of single-gauge tests in which each station is considered independently, going through procedures to assess possible equipment malfunctions through data analysis like long rainless periods or with constant tips due to clogging, spurious rainfall peaks and long periods missing data. Afterwards, the gauges are analyzed along its closest neighbors through spatial outlier detection using Local Moran’s Index. In this study it was assembled a database containing High-Quality stations of the seven years analyzed, which was also used for the performance analysis of the automatic quality control procedure through a confusion matrix. With the single gauge tests, the errors on the TBRG were automatically identified, and the outlier identification through spatial analysis using the Moran’s Index had also proven to be an efficient tool to identify possible equipment malfunctions. Furthermore, the results had shown an average accuracy of 94.2% for the High-Quality rain gauges and 78.4% for the malfunctioning stations, therefore few well-functioning stations were removed from the final database without inserting many Poor-Quality stations.
id UFPB_1193213c2fedecaaf45a8eef9b39c81f
oai_identifier_str oai:repositorio.ufpb.br:123456789/23143
network_acronym_str UFPB
network_name_str Biblioteca Digital de Teses e Dissertações da UFPB
repository_id_str
spelling Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scalesControle de qualidadeSub-horárioPrecipitaçãoPluviógrafoMITAutocorrelação espacialQuality controlSub-hourlyPrecipitationRain gaugeInter-event timeSpatial autocorrelationCNPQ::ENGENHARIAS::ENGENHARIA CIVILThere has been an increase on the intensity of rainfall extreme events. These events have high contribution on hazards in urban areas, such as flash flooding, landslides and excessive erosion, which leads to social, economic and environmental damage. Sub-hourly rainfall information has a critical role in the assessment of such natural disasters, however, the monitoring networks in developing countries still lack High-Quality data. Therefore, this study aims to present a new quality control procedure for sub-hourly rainfall data in Brazil, analyzing 7 years (2014-2020) of tipping bucket rain gauge data, in a sub-hourly scale, from CEMADEN’s (Brazilian National Centre for Monitoring and Early Warnings of Natural Disasters) rain gauges network. The proposed method is made separately each year through a series of single-gauge tests in which each station is considered independently, going through procedures to assess possible equipment malfunctions through data analysis like long rainless periods or with constant tips due to clogging, spurious rainfall peaks and long periods missing data. Afterwards, the gauges are analyzed along its closest neighbors through spatial outlier detection using Local Moran’s Index. In this study it was assembled a database containing High-Quality stations of the seven years analyzed, which was also used for the performance analysis of the automatic quality control procedure through a confusion matrix. With the single gauge tests, the errors on the TBRG were automatically identified, and the outlier identification through spatial analysis using the Moran’s Index had also proven to be an efficient tool to identify possible equipment malfunctions. Furthermore, the results had shown an average accuracy of 94.2% for the High-Quality rain gauges and 78.4% for the malfunctioning stations, therefore few well-functioning stations were removed from the final database without inserting many Poor-Quality stations.Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - CAPESA intensidade dos eventos extremos de precipitação vem crescendo a cada ano. Esses eventos têm grande contribuição sobre desastres naturais em áreas urbanas, como enchentes, deslizamentos de terra e erosão excessiva, o que leva a danos sociais, econômicos e ambientais. Os dados sub-horários de precipitação têm um papel crítico na avaliação de tais desastres; no entanto, as redes de monitoramento nos países em desenvolvimento, como o Brasil, ainda carecem de dados de alta qualidade e séries longas. Portanto, este estudo objetiva apresentar um novo procedimento de controle de qualidade para dados sub-horários de precipitação no Brasil, analisando 7 anos (2014-2020) de dados na escala sub-horária (10 min) da rede de monitoramento do CEMADEN (Centro Nacional de Monitoramento e Alertas de Desastres Naturais). O método proposto é aplicado separadamente a cada ano através de uma série de testes, nos quais as estações são inicialmente consideradas de forma independente para avaliar possíveis erros de medição através de seus dados, como períodos longos sem chuva ou com chuva constante por conta de entupimento, picos de precipitação irreais, e longos períodos sem registros. Posteriormente, as estações são analisadas em conjunto com seus vizinhos mais próximos através da detecção de outliers espaciais utilizando o Índice Local de Moran. Neste trabalho foi criada uma base de dados contendo estações de alta qualidade dos sete anos analisados, que foi também utilizada para a análise de performance do procedimento de controle de qualidade automático através de uma matriz de confusão. Com os testes independentes foi possível identificar automaticamente os erros nas estações, assim como na utilização do Índice Local de Moran, que se mostrou uma ferramenta eficiente para esta análise. Ademais, os resultados dessa análise mostraram uma média de acerto de 94.2% para as estações de alta qualidade e 78.4% das estações defeituosas, de modo que poucas estações com o correto funcionamento foram retiradas da base de dados final sem inserir muitas estações de baixa qualidade.Universidade Federal da ParaíbaBrasilEngenharia Civil e AmbientalPrograma de Pós-Graduação em Engenharia Civil e AmbientalUFPBAlmeida, Cristiano das Neveshttp://lattes.cnpq.br/5858373824027435Coelho, Victor Hugo Rabelohttp://lattes.cnpq.br/5109911884566474Meira, Marcela Antunes2022-06-14T18:54:19Z2021-09-202022-06-14T18:54:19Z2021-07-26info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesishttps://repositorio.ufpb.br/jspui/handle/123456789/23143porAttribution-NoDerivs 3.0 Brazilhttp://creativecommons.org/licenses/by-nd/3.0/br/info:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFPBinstname:Universidade Federal da Paraíba (UFPB)instacron:UFPB2022-06-15T13:43:09Zoai:repositorio.ufpb.br:123456789/23143Biblioteca Digital de Teses e Dissertaçõeshttps://repositorio.ufpb.br/PUBhttp://tede.biblioteca.ufpb.br:8080/oai/requestdiretoria@ufpb.br|| diretoria@ufpb.bropendoar:2022-06-15T13:43:09Biblioteca Digital de Teses e Dissertações da UFPB - Universidade Federal da Paraíba (UFPB)false
dc.title.none.fl_str_mv Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales
title Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales
spellingShingle Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales
Meira, Marcela Antunes
Controle de qualidade
Sub-horário
Precipitação
Pluviógrafo
MIT
Autocorrelação espacial
Quality control
Sub-hourly
Precipitation
Rain gauge
Inter-event time
Spatial autocorrelation
CNPQ::ENGENHARIAS::ENGENHARIA CIVIL
title_short Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales
title_full Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales
title_fullStr Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales
title_full_unstemmed Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales
title_sort Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales
author Meira, Marcela Antunes
author_facet Meira, Marcela Antunes
author_role author
dc.contributor.none.fl_str_mv Almeida, Cristiano das Neves
http://lattes.cnpq.br/5858373824027435
Coelho, Victor Hugo Rabelo
http://lattes.cnpq.br/5109911884566474
dc.contributor.author.fl_str_mv Meira, Marcela Antunes
dc.subject.por.fl_str_mv Controle de qualidade
Sub-horário
Precipitação
Pluviógrafo
MIT
Autocorrelação espacial
Quality control
Sub-hourly
Precipitation
Rain gauge
Inter-event time
Spatial autocorrelation
CNPQ::ENGENHARIAS::ENGENHARIA CIVIL
topic Controle de qualidade
Sub-horário
Precipitação
Pluviógrafo
MIT
Autocorrelação espacial
Quality control
Sub-hourly
Precipitation
Rain gauge
Inter-event time
Spatial autocorrelation
CNPQ::ENGENHARIAS::ENGENHARIA CIVIL
description There has been an increase on the intensity of rainfall extreme events. These events have high contribution on hazards in urban areas, such as flash flooding, landslides and excessive erosion, which leads to social, economic and environmental damage. Sub-hourly rainfall information has a critical role in the assessment of such natural disasters, however, the monitoring networks in developing countries still lack High-Quality data. Therefore, this study aims to present a new quality control procedure for sub-hourly rainfall data in Brazil, analyzing 7 years (2014-2020) of tipping bucket rain gauge data, in a sub-hourly scale, from CEMADEN’s (Brazilian National Centre for Monitoring and Early Warnings of Natural Disasters) rain gauges network. The proposed method is made separately each year through a series of single-gauge tests in which each station is considered independently, going through procedures to assess possible equipment malfunctions through data analysis like long rainless periods or with constant tips due to clogging, spurious rainfall peaks and long periods missing data. Afterwards, the gauges are analyzed along its closest neighbors through spatial outlier detection using Local Moran’s Index. In this study it was assembled a database containing High-Quality stations of the seven years analyzed, which was also used for the performance analysis of the automatic quality control procedure through a confusion matrix. With the single gauge tests, the errors on the TBRG were automatically identified, and the outlier identification through spatial analysis using the Moran’s Index had also proven to be an efficient tool to identify possible equipment malfunctions. Furthermore, the results had shown an average accuracy of 94.2% for the High-Quality rain gauges and 78.4% for the malfunctioning stations, therefore few well-functioning stations were removed from the final database without inserting many Poor-Quality stations.
publishDate 2021
dc.date.none.fl_str_mv 2021-09-20
2021-07-26
2022-06-14T18:54:19Z
2022-06-14T18:54:19Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://repositorio.ufpb.br/jspui/handle/123456789/23143
url https://repositorio.ufpb.br/jspui/handle/123456789/23143
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv Attribution-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nd/3.0/br/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nd/3.0/br/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal da Paraíba
Brasil
Engenharia Civil e Ambiental
Programa de Pós-Graduação em Engenharia Civil e Ambiental
UFPB
publisher.none.fl_str_mv Universidade Federal da Paraíba
Brasil
Engenharia Civil e Ambiental
Programa de Pós-Graduação em Engenharia Civil e Ambiental
UFPB
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações da UFPB
instname:Universidade Federal da Paraíba (UFPB)
instacron:UFPB
instname_str Universidade Federal da Paraíba (UFPB)
instacron_str UFPB
institution UFPB
reponame_str Biblioteca Digital de Teses e Dissertações da UFPB
collection Biblioteca Digital de Teses e Dissertações da UFPB
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da UFPB - Universidade Federal da Paraíba (UFPB)
repository.mail.fl_str_mv diretoria@ufpb.br|| diretoria@ufpb.br
_version_ 1801842994788171776