Construção de um pipeline de dados para o Sistema Alerta Rio utilizando Knime Analytics Platform

• Autor(a) principal: Germano, Vinicius Tavares Martins
• Data de Publicação: 2023
• Outros Autores: [e-mail]
• Tipo de documento: Dissertação
• Idioma: por
• Título da fonte: Biblioteca Digital de Teses e Dissertações da UERJ
• Texto Completo: http://www.bdtd.uerj.br/handle/1/20703
• topic: Rio Alert System; Big Data; Pipeline; Open Data; Sistema Alerta Rio; Dados Abertos; Big Data; Pipeline; CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO::SISTEMAS DE COMPUTACAO

The present work is framed within the Open Science paradigm, which, catalyzed by the development of digital technologies, advocates for scientific sharing and collaboration. In this context, open government data are recognized as relevant research inputs. The Sistema Alerta Rio provides meteorological and rainfall data for the municipality of Rio de Janeiro, albeit without proper data structuring. This study employed Data Engineering techniques using Knime software, with the goal of developing a pipeline for integration, cleaning and analysis of these data, following principles of reproducibility, rigor and transparency espoused by Open Science. The curated data were consolidated into a new database (Data Staging) and made available in the Mendeley Data repository. The developed database can be used as a source for future studies, for interpretation and discussion of results, as well as for new processing steps and integration with other data sources, enabling machine learning applications.