Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU

Detalhes bibliográficos
Autor(a) principal: Silva, F?bio Cardozo da
Data de Publicação: 2014
Tipo de documento: Dissertação
Idioma: por
Título da fonte: Biblioteca Digital de Teses e Dissertações da UFRRJ
Texto Completo: https://tede.ufrrj.br/jspui/handle/jspui/3124
Resumo: Despite of the growing importance of researches in the field of Meteorology, especially those that handle large volumes of data focused on studies of hidrological resources, difficulties the handle datasets are increasing. Researchers are developing great efforts to obtain and store high quality data in their repositories. This dissertation aims to present a computational proposal capable to compute meteorological data and add quality control to long times series of data. The artifacts conceived and developed in this work are based on the e-Science vision. We used high performance processing features and scientific workflows to aid to automate the process of scientific research in Meteorology. Furthermore, this work integrates VisTrails scientific workflows with parallel computing environments using GPU and CUDA programming. The integration was guided to extend the capability of handling large volumes of hihg quality meteorological data. Other features of this work are the discussions about performance gains of the proposal and the representation of (raw and curated) data and retrospective provenance generated by the computational experiments according to PROV-DM specification. The main results of this work are. 87,7% of detection of errors and failures replacemente were achieved using 77 meteorological stations. We can conclude that the fusion of E-Sceince vision with CUDA parallel computing approach is viable to deal with large volumes of meterological and climatological data.
id UFRRJ-1_6b41c97562cd29e6c2946573a4d5e01c
oai_identifier_str oai:localhost:jspui/3124
network_acronym_str UFRRJ-1
network_name_str Biblioteca Digital de Teses e Dissertações da UFRRJ
repository_id_str
spelling Cruz, S?rgio Manuel Serra da848.488.637-91Vieira, Priscila Machado LimaCruz, S?rgio Manuel Serra daGoldschmidt, Ronaldo RibeiroLyra, Gustavo Bastos082.278.207-35http://lattes.cnpq.br/2034219453382798Silva, F?bio Cardozo da2019-11-28T19:55:31Z2014-09-18SILVA, F?bio Cardozo da. Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU. 2014. 53 f. Disserta??o (Mestrado em Modelagem Matem?tica e Computacional). Instituto de Ci?ncias Exatas, Universidade Federal Rural do Rio de Janeiro, Serop?dica, RJ, 2014.https://tede.ufrrj.br/jspui/handle/jspui/3124Despite of the growing importance of researches in the field of Meteorology, especially those that handle large volumes of data focused on studies of hidrological resources, difficulties the handle datasets are increasing. Researchers are developing great efforts to obtain and store high quality data in their repositories. This dissertation aims to present a computational proposal capable to compute meteorological data and add quality control to long times series of data. The artifacts conceived and developed in this work are based on the e-Science vision. We used high performance processing features and scientific workflows to aid to automate the process of scientific research in Meteorology. Furthermore, this work integrates VisTrails scientific workflows with parallel computing environments using GPU and CUDA programming. The integration was guided to extend the capability of handling large volumes of hihg quality meteorological data. Other features of this work are the discussions about performance gains of the proposal and the representation of (raw and curated) data and retrospective provenance generated by the computational experiments according to PROV-DM specification. The main results of this work are. 87,7% of detection of errors and failures replacemente were achieved using 77 meteorological stations. We can conclude that the fusion of E-Sceince vision with CUDA parallel computing approach is viable to deal with large volumes of meterological and climatological data.Juntamente com a crescente import?ncia das pesquisas na ?rea de meteorologia e climatologia, principalmente as que manipulam grandes volumes de dados voltados aos estudos dos recursos h?dricos, surgem as dificuldades para que os pesquisadores dessas ?reas obtenham e armazenem dados de alta qualidade em seus reposit?rios. Este trabalho tem como objetivo apresentar uma proposta na ?rea computacional capaz de processar dados meteorol?gicos agregando controle de qualidade a longas s?ries hist?ricas de dados em hidrologia. Os artefatos deste trabalho s?o baseados na vis?o da e-Science, utilizando workflows cient?ficos em ambientes de processamento de alto desempenho que tem por finalidade automatizar parte das etapas de pesquisas cient?ficas em meteorologia. Al?m disso, este trabalho prop?e a integra??o de workflows cient?ficos desenvolvidos na plataforma VisTrails com a computa??o paralela em ambientes GPU utilizando c?digos CUDA. Essa integra??o visa ampliar a capacidade de manipula??o de grandes volumes de dados hidrol?gicos. Outra caracter?stica desse trabalho s?o a apresenta??o dos ganhos de desempenho da solu??o computacional e a representa??o dos dados relativos ? proveni?ncia retrospectiva dos experimentos segundo os moldes da especifica??o PROV-DM. Como um dos principais resultados temos o ?ndice de identifica??o e corre??o de falhas de 87,7%, nos testes realizados com 77 esta??es, o que representa um ganho precioso de tempo na prepara??o de dados nas pesquisas da ?rea. Com isso pode-se concluir que a combina??o da vis?o da e-Ci?ncia associada a tecnologia de computa??o paralela CUDA, al?m de vi?vel, se torna uma alternativa no tratamento de grandes volumes de dados na ?rea de Meteorologia e Climatologia.Submitted by Jorge Silva (jorgelmsilva@ufrrj.br) on 2019-11-28T19:55:31Z No. of bitstreams: 1 2014 - F?bio Cardozo da Silva.pdf: 2429209 bytes, checksum: 16885cae90a97ecd6143fa286cc437e5 (MD5)Made available in DSpace on 2019-11-28T19:55:31Z (GMT). No. of bitstreams: 1 2014 - F?bio Cardozo da Silva.pdf: 2429209 bytes, checksum: 16885cae90a97ecd6143fa286cc437e5 (MD5) Previous issue date: 2014-09-18application/pdfhttps://tede.ufrrj.br/retrieve/11543/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/16888/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/23202/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/29578/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/35952/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/42348/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/48730/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/55180/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpgporUniversidade Federal Rural do Rio de JaneiroPrograma de P?s-Gradua??o em Modelagem Matem?tica e ComputacionalUFRRJBrasilInstituto de Ci?ncias ExatasMeteorologiaClimatologiae-Ci?nciaProveni?nciaWorkflows Cient?ficosHidrologiaComputa??o paralelaMeteorologyClimatologye-ScienceProvenanceScientific WorkflowsHidrologParalel ComputingMatem?ticaTratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPUinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisinfo:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFRRJinstname:Universidade Federal Rural do Rio de Janeiro (UFRRJ)instacron:UFRRJTHUMBNAIL2014 - F?bio Cardozo da Silva.pdf.jpg2014 - F?bio Cardozo da Silva.pdf.jpgimage/jpeg1943http://localhost:8080/tede/bitstream/jspui/3124/18/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf.jpgcc73c4c239a4c332d642ba1e7c7a9fb2MD518TEXT2014 - F?bio Cardozo da Silva.pdf.txt2014 - F?bio Cardozo da Silva.pdf.txttext/plain114426http://localhost:8080/tede/bitstream/jspui/3124/17/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf.txt4cdb4cf80bc1f7f0aab0a9d1b565d149MD517ORIGINAL2014 - F?bio Cardozo da Silva.pdf2014 - F?bio Cardozo da Silva.pdfapplication/pdf2429209http://localhost:8080/tede/bitstream/jspui/3124/2/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf16885cae90a97ecd6143fa286cc437e5MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-82089http://localhost:8080/tede/bitstream/jspui/3124/1/license.txt7b5ba3d2445355f386edab96125d42b7MD51jspui/31242022-02-10 11:45:57.165oai:localhost:jspui/3124Tk9UQTogQ09MT1FVRSBBUVVJIEEgU1VBIFBSP1BSSUEgTElDRU4/QQpFc3RhIGxpY2VuP2EgZGUgZXhlbXBsbyA/IGZvcm5lY2lkYSBhcGVuYXMgcGFyYSBmaW5zIGluZm9ybWF0aXZvcy4KCkxJQ0VOP0EgREUgRElTVFJJQlVJPz9PIE4/Ty1FWENMVVNJVkEKCkNvbSBhIGFwcmVzZW50YT8/byBkZXN0YSBsaWNlbj9hLCB2b2M/IChvIGF1dG9yIChlcykgb3UgbyB0aXR1bGFyIGRvcyBkaXJlaXRvcyBkZSBhdXRvcikgY29uY2VkZSA/IFVuaXZlcnNpZGFkZSAKWFhYIChTaWdsYSBkYSBVbml2ZXJzaWRhZGUpIG8gZGlyZWl0byBuP28tZXhjbHVzaXZvIGRlIHJlcHJvZHV6aXIsICB0cmFkdXppciAoY29uZm9ybWUgZGVmaW5pZG8gYWJhaXhvKSwgZS9vdSAKZGlzdHJpYnVpciBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhPz9vIChpbmNsdWluZG8gbyByZXN1bW8pIHBvciB0b2RvIG8gbXVuZG8gbm8gZm9ybWF0byBpbXByZXNzbyBlIGVsZXRyP25pY28gZSAKZW0gcXVhbHF1ZXIgbWVpbywgaW5jbHVpbmRvIG9zIGZvcm1hdG9zID91ZGlvIG91IHY/ZGVvLgoKVm9jPyBjb25jb3JkYSBxdWUgYSBTaWdsYSBkZSBVbml2ZXJzaWRhZGUgcG9kZSwgc2VtIGFsdGVyYXIgbyBjb250ZT9kbywgdHJhbnNwb3IgYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YT8/byAKcGFyYSBxdWFscXVlciBtZWlvIG91IGZvcm1hdG8gcGFyYSBmaW5zIGRlIHByZXNlcnZhPz9vLgoKVm9jPyB0YW1iP20gY29uY29yZGEgcXVlIGEgU2lnbGEgZGUgVW5pdmVyc2lkYWRlIHBvZGUgbWFudGVyIG1haXMgZGUgdW1hIGM/cGlhIGEgc3VhIHRlc2Ugb3UgCmRpc3NlcnRhPz9vIHBhcmEgZmlucyBkZSBzZWd1cmFuP2EsIGJhY2stdXAgZSBwcmVzZXJ2YT8/by4KClZvYz8gZGVjbGFyYSBxdWUgYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YT8/byA/IG9yaWdpbmFsIGUgcXVlIHZvYz8gdGVtIG8gcG9kZXIgZGUgY29uY2VkZXIgb3MgZGlyZWl0b3MgY29udGlkb3MgCm5lc3RhIGxpY2VuP2EuIFZvYz8gdGFtYj9tIGRlY2xhcmEgcXVlIG8gZGVwP3NpdG8gZGEgc3VhIHRlc2Ugb3UgZGlzc2VydGE/P28gbj9vLCBxdWUgc2VqYSBkZSBzZXUgCmNvbmhlY2ltZW50bywgaW5mcmluZ2UgZGlyZWl0b3MgYXV0b3JhaXMgZGUgbmluZ3U/bS4KCkNhc28gYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YT8/byBjb250ZW5oYSBtYXRlcmlhbCBxdWUgdm9jPyBuP28gcG9zc3VpIGEgdGl0dWxhcmlkYWRlIGRvcyBkaXJlaXRvcyBhdXRvcmFpcywgdm9jPyAKZGVjbGFyYSBxdWUgb2J0ZXZlIGEgcGVybWlzcz9vIGlycmVzdHJpdGEgZG8gZGV0ZW50b3IgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIHBhcmEgY29uY2VkZXIgPyBTaWdsYSBkZSBVbml2ZXJzaWRhZGUgCm9zIGRpcmVpdG9zIGFwcmVzZW50YWRvcyBuZXN0YSBsaWNlbj9hLCBlIHF1ZSBlc3NlIG1hdGVyaWFsIGRlIHByb3ByaWVkYWRlIGRlIHRlcmNlaXJvcyBlc3Q/IGNsYXJhbWVudGUgCmlkZW50aWZpY2FkbyBlIHJlY29uaGVjaWRvIG5vIHRleHRvIG91IG5vIGNvbnRlP2RvIGRhIHRlc2Ugb3UgZGlzc2VydGE/P28gb3JhIGRlcG9zaXRhZGEuCgpDQVNPIEEgVEVTRSBPVSBESVNTRVJUQT8/TyBPUkEgREVQT1NJVEFEQSBURU5IQSBTSURPIFJFU1VMVEFETyBERSBVTSBQQVRST0M/TklPIE9VIApBUE9JTyBERSBVTUEgQUc/TkNJQSBERSBGT01FTlRPIE9VIE9VVFJPIE9SR0FOSVNNTyBRVUUgTj9PIFNFSkEgQSBTSUdMQSBERSAKVU5JVkVSU0lEQURFLCBWT0M/IERFQ0xBUkEgUVVFIFJFU1BFSVRPVSBUT0RPUyBFIFFVQUlTUVVFUiBESVJFSVRPUyBERSBSRVZJUz9PIENPTU8gClRBTUI/TSBBUyBERU1BSVMgT0JSSUdBPz9FUyBFWElHSURBUyBQT1IgQ09OVFJBVE8gT1UgQUNPUkRPLgoKQSBTaWdsYSBkZSBVbml2ZXJzaWRhZGUgc2UgY29tcHJvbWV0ZSBhIGlkZW50aWZpY2FyIGNsYXJhbWVudGUgbyBzZXUgbm9tZSAocykgb3UgbyhzKSBub21lKHMpIGRvKHMpIApkZXRlbnRvcihlcykgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIGRhIHRlc2Ugb3UgZGlzc2VydGE/P28sIGUgbj9vIGZhcj8gcXVhbHF1ZXIgYWx0ZXJhPz9vLCBhbD9tIGRhcXVlbGFzIApjb25jZWRpZGFzIHBvciBlc3RhIGxpY2VuP2EuCg==Biblioteca Digital de Teses e Dissertaçõeshttps://tede.ufrrj.br/PUBhttps://tede.ufrrj.br/oai/requestbibliot@ufrrj.br||bibliot@ufrrj.bropendoar:2022-02-10T13:45:57Biblioteca Digital de Teses e Dissertações da UFRRJ - Universidade Federal Rural do Rio de Janeiro (UFRRJ)false
dc.title.por.fl_str_mv Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU
title Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU
spellingShingle Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU
Silva, F?bio Cardozo da
Meteorologia
Climatologia
e-Ci?ncia
Proveni?ncia
Workflows Cient?ficos
Hidrologia
Computa??o paralela
Meteorology
Climatology
e-Science
Provenance
Scientific Workflows
Hidrolog
Paralel Computing
Matem?tica
title_short Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU
title_full Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU
title_fullStr Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU
title_full_unstemmed Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU
title_sort Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU
author Silva, F?bio Cardozo da
author_facet Silva, F?bio Cardozo da
author_role author
dc.contributor.advisor1.fl_str_mv Cruz, S?rgio Manuel Serra da
dc.contributor.advisor1ID.fl_str_mv 848.488.637-91
dc.contributor.advisor-co1.fl_str_mv Vieira, Priscila Machado Lima
dc.contributor.referee1.fl_str_mv Cruz, S?rgio Manuel Serra da
dc.contributor.referee2.fl_str_mv Goldschmidt, Ronaldo Ribeiro
dc.contributor.referee3.fl_str_mv Lyra, Gustavo Bastos
dc.contributor.authorID.fl_str_mv 082.278.207-35
dc.contributor.authorLattes.fl_str_mv http://lattes.cnpq.br/2034219453382798
dc.contributor.author.fl_str_mv Silva, F?bio Cardozo da
contributor_str_mv Cruz, S?rgio Manuel Serra da
Vieira, Priscila Machado Lima
Cruz, S?rgio Manuel Serra da
Goldschmidt, Ronaldo Ribeiro
Lyra, Gustavo Bastos
dc.subject.por.fl_str_mv Meteorologia
Climatologia
e-Ci?ncia
Proveni?ncia
Workflows Cient?ficos
Hidrologia
Computa??o paralela
topic Meteorologia
Climatologia
e-Ci?ncia
Proveni?ncia
Workflows Cient?ficos
Hidrologia
Computa??o paralela
Meteorology
Climatology
e-Science
Provenance
Scientific Workflows
Hidrolog
Paralel Computing
Matem?tica
dc.subject.eng.fl_str_mv Meteorology
Climatology
e-Science
Provenance
Scientific Workflows
Hidrolog
Paralel Computing
dc.subject.cnpq.fl_str_mv Matem?tica
description Despite of the growing importance of researches in the field of Meteorology, especially those that handle large volumes of data focused on studies of hidrological resources, difficulties the handle datasets are increasing. Researchers are developing great efforts to obtain and store high quality data in their repositories. This dissertation aims to present a computational proposal capable to compute meteorological data and add quality control to long times series of data. The artifacts conceived and developed in this work are based on the e-Science vision. We used high performance processing features and scientific workflows to aid to automate the process of scientific research in Meteorology. Furthermore, this work integrates VisTrails scientific workflows with parallel computing environments using GPU and CUDA programming. The integration was guided to extend the capability of handling large volumes of hihg quality meteorological data. Other features of this work are the discussions about performance gains of the proposal and the representation of (raw and curated) data and retrospective provenance generated by the computational experiments according to PROV-DM specification. The main results of this work are. 87,7% of detection of errors and failures replacemente were achieved using 77 meteorological stations. We can conclude that the fusion of E-Sceince vision with CUDA parallel computing approach is viable to deal with large volumes of meterological and climatological data.
publishDate 2014
dc.date.issued.fl_str_mv 2014-09-18
dc.date.accessioned.fl_str_mv 2019-11-28T19:55:31Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv SILVA, F?bio Cardozo da. Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU. 2014. 53 f. Disserta??o (Mestrado em Modelagem Matem?tica e Computacional). Instituto de Ci?ncias Exatas, Universidade Federal Rural do Rio de Janeiro, Serop?dica, RJ, 2014.
dc.identifier.uri.fl_str_mv https://tede.ufrrj.br/jspui/handle/jspui/3124
identifier_str_mv SILVA, F?bio Cardozo da. Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU. 2014. 53 f. Disserta??o (Mestrado em Modelagem Matem?tica e Computacional). Instituto de Ci?ncias Exatas, Universidade Federal Rural do Rio de Janeiro, Serop?dica, RJ, 2014.
url https://tede.ufrrj.br/jspui/handle/jspui/3124
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidade Federal Rural do Rio de Janeiro
dc.publisher.program.fl_str_mv Programa de P?s-Gradua??o em Modelagem Matem?tica e Computacional
dc.publisher.initials.fl_str_mv UFRRJ
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv Instituto de Ci?ncias Exatas
publisher.none.fl_str_mv Universidade Federal Rural do Rio de Janeiro
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações da UFRRJ
instname:Universidade Federal Rural do Rio de Janeiro (UFRRJ)
instacron:UFRRJ
instname_str Universidade Federal Rural do Rio de Janeiro (UFRRJ)
instacron_str UFRRJ
institution UFRRJ
reponame_str Biblioteca Digital de Teses e Dissertações da UFRRJ
collection Biblioteca Digital de Teses e Dissertações da UFRRJ
bitstream.url.fl_str_mv http://localhost:8080/tede/bitstream/jspui/3124/18/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf.jpg
http://localhost:8080/tede/bitstream/jspui/3124/17/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf.txt
http://localhost:8080/tede/bitstream/jspui/3124/2/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf
http://localhost:8080/tede/bitstream/jspui/3124/1/license.txt
bitstream.checksum.fl_str_mv cc73c4c239a4c332d642ba1e7c7a9fb2
4cdb4cf80bc1f7f0aab0a9d1b565d149
16885cae90a97ecd6143fa286cc437e5
7b5ba3d2445355f386edab96125d42b7
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da UFRRJ - Universidade Federal Rural do Rio de Janeiro (UFRRJ)
repository.mail.fl_str_mv bibliot@ufrrj.br||bibliot@ufrrj.br
_version_ 1800313494739877888