Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales
Autor(a) principal: | |
---|---|
Data de Publicação: | 2021 |
Tipo de documento: | Dissertação |
Idioma: | por |
Título da fonte: | Biblioteca Digital de Teses e Dissertações da UFPB |
Texto Completo: | https://repositorio.ufpb.br/jspui/handle/123456789/23143 |
Resumo: | There has been an increase on the intensity of rainfall extreme events. These events have high contribution on hazards in urban areas, such as flash flooding, landslides and excessive erosion, which leads to social, economic and environmental damage. Sub-hourly rainfall information has a critical role in the assessment of such natural disasters, however, the monitoring networks in developing countries still lack High-Quality data. Therefore, this study aims to present a new quality control procedure for sub-hourly rainfall data in Brazil, analyzing 7 years (2014-2020) of tipping bucket rain gauge data, in a sub-hourly scale, from CEMADEN’s (Brazilian National Centre for Monitoring and Early Warnings of Natural Disasters) rain gauges network. The proposed method is made separately each year through a series of single-gauge tests in which each station is considered independently, going through procedures to assess possible equipment malfunctions through data analysis like long rainless periods or with constant tips due to clogging, spurious rainfall peaks and long periods missing data. Afterwards, the gauges are analyzed along its closest neighbors through spatial outlier detection using Local Moran’s Index. In this study it was assembled a database containing High-Quality stations of the seven years analyzed, which was also used for the performance analysis of the automatic quality control procedure through a confusion matrix. With the single gauge tests, the errors on the TBRG were automatically identified, and the outlier identification through spatial analysis using the Moran’s Index had also proven to be an efficient tool to identify possible equipment malfunctions. Furthermore, the results had shown an average accuracy of 94.2% for the High-Quality rain gauges and 78.4% for the malfunctioning stations, therefore few well-functioning stations were removed from the final database without inserting many Poor-Quality stations. |
id |
UFPB_1193213c2fedecaaf45a8eef9b39c81f |
---|---|
oai_identifier_str |
oai:repositorio.ufpb.br:123456789/23143 |
network_acronym_str |
UFPB |
network_name_str |
Biblioteca Digital de Teses e Dissertações da UFPB |
repository_id_str |
|
spelling |
Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scalesControle de qualidadeSub-horárioPrecipitaçãoPluviógrafoMITAutocorrelação espacialQuality controlSub-hourlyPrecipitationRain gaugeInter-event timeSpatial autocorrelationCNPQ::ENGENHARIAS::ENGENHARIA CIVILThere has been an increase on the intensity of rainfall extreme events. These events have high contribution on hazards in urban areas, such as flash flooding, landslides and excessive erosion, which leads to social, economic and environmental damage. Sub-hourly rainfall information has a critical role in the assessment of such natural disasters, however, the monitoring networks in developing countries still lack High-Quality data. Therefore, this study aims to present a new quality control procedure for sub-hourly rainfall data in Brazil, analyzing 7 years (2014-2020) of tipping bucket rain gauge data, in a sub-hourly scale, from CEMADEN’s (Brazilian National Centre for Monitoring and Early Warnings of Natural Disasters) rain gauges network. The proposed method is made separately each year through a series of single-gauge tests in which each station is considered independently, going through procedures to assess possible equipment malfunctions through data analysis like long rainless periods or with constant tips due to clogging, spurious rainfall peaks and long periods missing data. Afterwards, the gauges are analyzed along its closest neighbors through spatial outlier detection using Local Moran’s Index. In this study it was assembled a database containing High-Quality stations of the seven years analyzed, which was also used for the performance analysis of the automatic quality control procedure through a confusion matrix. With the single gauge tests, the errors on the TBRG were automatically identified, and the outlier identification through spatial analysis using the Moran’s Index had also proven to be an efficient tool to identify possible equipment malfunctions. Furthermore, the results had shown an average accuracy of 94.2% for the High-Quality rain gauges and 78.4% for the malfunctioning stations, therefore few well-functioning stations were removed from the final database without inserting many Poor-Quality stations.Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - CAPESA intensidade dos eventos extremos de precipitação vem crescendo a cada ano. Esses eventos têm grande contribuição sobre desastres naturais em áreas urbanas, como enchentes, deslizamentos de terra e erosão excessiva, o que leva a danos sociais, econômicos e ambientais. Os dados sub-horários de precipitação têm um papel crítico na avaliação de tais desastres; no entanto, as redes de monitoramento nos países em desenvolvimento, como o Brasil, ainda carecem de dados de alta qualidade e séries longas. Portanto, este estudo objetiva apresentar um novo procedimento de controle de qualidade para dados sub-horários de precipitação no Brasil, analisando 7 anos (2014-2020) de dados na escala sub-horária (10 min) da rede de monitoramento do CEMADEN (Centro Nacional de Monitoramento e Alertas de Desastres Naturais). O método proposto é aplicado separadamente a cada ano através de uma série de testes, nos quais as estações são inicialmente consideradas de forma independente para avaliar possíveis erros de medição através de seus dados, como períodos longos sem chuva ou com chuva constante por conta de entupimento, picos de precipitação irreais, e longos períodos sem registros. Posteriormente, as estações são analisadas em conjunto com seus vizinhos mais próximos através da detecção de outliers espaciais utilizando o Índice Local de Moran. Neste trabalho foi criada uma base de dados contendo estações de alta qualidade dos sete anos analisados, que foi também utilizada para a análise de performance do procedimento de controle de qualidade automático através de uma matriz de confusão. Com os testes independentes foi possível identificar automaticamente os erros nas estações, assim como na utilização do Índice Local de Moran, que se mostrou uma ferramenta eficiente para esta análise. Ademais, os resultados dessa análise mostraram uma média de acerto de 94.2% para as estações de alta qualidade e 78.4% das estações defeituosas, de modo que poucas estações com o correto funcionamento foram retiradas da base de dados final sem inserir muitas estações de baixa qualidade.Universidade Federal da ParaíbaBrasilEngenharia Civil e AmbientalPrograma de Pós-Graduação em Engenharia Civil e AmbientalUFPBAlmeida, Cristiano das Neveshttp://lattes.cnpq.br/5858373824027435Coelho, Victor Hugo Rabelohttp://lattes.cnpq.br/5109911884566474Meira, Marcela Antunes2022-06-14T18:54:19Z2021-09-202022-06-14T18:54:19Z2021-07-26info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesishttps://repositorio.ufpb.br/jspui/handle/123456789/23143porAttribution-NoDerivs 3.0 Brazilhttp://creativecommons.org/licenses/by-nd/3.0/br/info:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFPBinstname:Universidade Federal da Paraíba (UFPB)instacron:UFPB2022-06-15T13:43:09Zoai:repositorio.ufpb.br:123456789/23143Biblioteca Digital de Teses e Dissertaçõeshttps://repositorio.ufpb.br/PUBhttp://tede.biblioteca.ufpb.br:8080/oai/requestdiretoria@ufpb.br|| diretoria@ufpb.bropendoar:2022-06-15T13:43:09Biblioteca Digital de Teses e Dissertações da UFPB - Universidade Federal da Paraíba (UFPB)false |
dc.title.none.fl_str_mv |
Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales |
title |
Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales |
spellingShingle |
Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales Meira, Marcela Antunes Controle de qualidade Sub-horário Precipitação Pluviógrafo MIT Autocorrelação espacial Quality control Sub-hourly Precipitation Rain gauge Inter-event time Spatial autocorrelation CNPQ::ENGENHARIAS::ENGENHARIA CIVIL |
title_short |
Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales |
title_full |
Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales |
title_fullStr |
Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales |
title_full_unstemmed |
Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales |
title_sort |
Quality control procedures for sub-hourly rainfall data: an investigation in different spatio-temporal scales |
author |
Meira, Marcela Antunes |
author_facet |
Meira, Marcela Antunes |
author_role |
author |
dc.contributor.none.fl_str_mv |
Almeida, Cristiano das Neves http://lattes.cnpq.br/5858373824027435 Coelho, Victor Hugo Rabelo http://lattes.cnpq.br/5109911884566474 |
dc.contributor.author.fl_str_mv |
Meira, Marcela Antunes |
dc.subject.por.fl_str_mv |
Controle de qualidade Sub-horário Precipitação Pluviógrafo MIT Autocorrelação espacial Quality control Sub-hourly Precipitation Rain gauge Inter-event time Spatial autocorrelation CNPQ::ENGENHARIAS::ENGENHARIA CIVIL |
topic |
Controle de qualidade Sub-horário Precipitação Pluviógrafo MIT Autocorrelação espacial Quality control Sub-hourly Precipitation Rain gauge Inter-event time Spatial autocorrelation CNPQ::ENGENHARIAS::ENGENHARIA CIVIL |
description |
There has been an increase on the intensity of rainfall extreme events. These events have high contribution on hazards in urban areas, such as flash flooding, landslides and excessive erosion, which leads to social, economic and environmental damage. Sub-hourly rainfall information has a critical role in the assessment of such natural disasters, however, the monitoring networks in developing countries still lack High-Quality data. Therefore, this study aims to present a new quality control procedure for sub-hourly rainfall data in Brazil, analyzing 7 years (2014-2020) of tipping bucket rain gauge data, in a sub-hourly scale, from CEMADEN’s (Brazilian National Centre for Monitoring and Early Warnings of Natural Disasters) rain gauges network. The proposed method is made separately each year through a series of single-gauge tests in which each station is considered independently, going through procedures to assess possible equipment malfunctions through data analysis like long rainless periods or with constant tips due to clogging, spurious rainfall peaks and long periods missing data. Afterwards, the gauges are analyzed along its closest neighbors through spatial outlier detection using Local Moran’s Index. In this study it was assembled a database containing High-Quality stations of the seven years analyzed, which was also used for the performance analysis of the automatic quality control procedure through a confusion matrix. With the single gauge tests, the errors on the TBRG were automatically identified, and the outlier identification through spatial analysis using the Moran’s Index had also proven to be an efficient tool to identify possible equipment malfunctions. Furthermore, the results had shown an average accuracy of 94.2% for the High-Quality rain gauges and 78.4% for the malfunctioning stations, therefore few well-functioning stations were removed from the final database without inserting many Poor-Quality stations. |
publishDate |
2021 |
dc.date.none.fl_str_mv |
2021-09-20 2021-07-26 2022-06-14T18:54:19Z 2022-06-14T18:54:19Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/masterThesis |
format |
masterThesis |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://repositorio.ufpb.br/jspui/handle/123456789/23143 |
url |
https://repositorio.ufpb.br/jspui/handle/123456789/23143 |
dc.language.iso.fl_str_mv |
por |
language |
por |
dc.rights.driver.fl_str_mv |
Attribution-NoDerivs 3.0 Brazil http://creativecommons.org/licenses/by-nd/3.0/br/ info:eu-repo/semantics/openAccess |
rights_invalid_str_mv |
Attribution-NoDerivs 3.0 Brazil http://creativecommons.org/licenses/by-nd/3.0/br/ |
eu_rights_str_mv |
openAccess |
dc.publisher.none.fl_str_mv |
Universidade Federal da Paraíba Brasil Engenharia Civil e Ambiental Programa de Pós-Graduação em Engenharia Civil e Ambiental UFPB |
publisher.none.fl_str_mv |
Universidade Federal da Paraíba Brasil Engenharia Civil e Ambiental Programa de Pós-Graduação em Engenharia Civil e Ambiental UFPB |
dc.source.none.fl_str_mv |
reponame:Biblioteca Digital de Teses e Dissertações da UFPB instname:Universidade Federal da Paraíba (UFPB) instacron:UFPB |
instname_str |
Universidade Federal da Paraíba (UFPB) |
instacron_str |
UFPB |
institution |
UFPB |
reponame_str |
Biblioteca Digital de Teses e Dissertações da UFPB |
collection |
Biblioteca Digital de Teses e Dissertações da UFPB |
repository.name.fl_str_mv |
Biblioteca Digital de Teses e Dissertações da UFPB - Universidade Federal da Paraíba (UFPB) |
repository.mail.fl_str_mv |
diretoria@ufpb.br|| diretoria@ufpb.br |
_version_ |
1801842994788171776 |