Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU
Autor(a) principal: | |
---|---|
Data de Publicação: | 2014 |
Tipo de documento: | Dissertação |
Idioma: | por |
Título da fonte: | Biblioteca Digital de Teses e Dissertações da UFRRJ |
Texto Completo: | https://tede.ufrrj.br/jspui/handle/jspui/3124 |
Resumo: | Despite of the growing importance of researches in the field of Meteorology, especially those that handle large volumes of data focused on studies of hidrological resources, difficulties the handle datasets are increasing. Researchers are developing great efforts to obtain and store high quality data in their repositories. This dissertation aims to present a computational proposal capable to compute meteorological data and add quality control to long times series of data. The artifacts conceived and developed in this work are based on the e-Science vision. We used high performance processing features and scientific workflows to aid to automate the process of scientific research in Meteorology. Furthermore, this work integrates VisTrails scientific workflows with parallel computing environments using GPU and CUDA programming. The integration was guided to extend the capability of handling large volumes of hihg quality meteorological data. Other features of this work are the discussions about performance gains of the proposal and the representation of (raw and curated) data and retrospective provenance generated by the computational experiments according to PROV-DM specification. The main results of this work are. 87,7% of detection of errors and failures replacemente were achieved using 77 meteorological stations. We can conclude that the fusion of E-Sceince vision with CUDA parallel computing approach is viable to deal with large volumes of meterological and climatological data. |
id |
UFRRJ-1_6b41c97562cd29e6c2946573a4d5e01c |
---|---|
oai_identifier_str |
oai:localhost:jspui/3124 |
network_acronym_str |
UFRRJ-1 |
network_name_str |
Biblioteca Digital de Teses e Dissertações da UFRRJ |
repository_id_str |
|
spelling |
Cruz, S?rgio Manuel Serra da848.488.637-91Vieira, Priscila Machado LimaCruz, S?rgio Manuel Serra daGoldschmidt, Ronaldo RibeiroLyra, Gustavo Bastos082.278.207-35http://lattes.cnpq.br/2034219453382798Silva, F?bio Cardozo da2019-11-28T19:55:31Z2014-09-18SILVA, F?bio Cardozo da. Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU. 2014. 53 f. Disserta??o (Mestrado em Modelagem Matem?tica e Computacional). Instituto de Ci?ncias Exatas, Universidade Federal Rural do Rio de Janeiro, Serop?dica, RJ, 2014.https://tede.ufrrj.br/jspui/handle/jspui/3124Despite of the growing importance of researches in the field of Meteorology, especially those that handle large volumes of data focused on studies of hidrological resources, difficulties the handle datasets are increasing. Researchers are developing great efforts to obtain and store high quality data in their repositories. This dissertation aims to present a computational proposal capable to compute meteorological data and add quality control to long times series of data. The artifacts conceived and developed in this work are based on the e-Science vision. We used high performance processing features and scientific workflows to aid to automate the process of scientific research in Meteorology. Furthermore, this work integrates VisTrails scientific workflows with parallel computing environments using GPU and CUDA programming. The integration was guided to extend the capability of handling large volumes of hihg quality meteorological data. Other features of this work are the discussions about performance gains of the proposal and the representation of (raw and curated) data and retrospective provenance generated by the computational experiments according to PROV-DM specification. The main results of this work are. 87,7% of detection of errors and failures replacemente were achieved using 77 meteorological stations. We can conclude that the fusion of E-Sceince vision with CUDA parallel computing approach is viable to deal with large volumes of meterological and climatological data.Juntamente com a crescente import?ncia das pesquisas na ?rea de meteorologia e climatologia, principalmente as que manipulam grandes volumes de dados voltados aos estudos dos recursos h?dricos, surgem as dificuldades para que os pesquisadores dessas ?reas obtenham e armazenem dados de alta qualidade em seus reposit?rios. Este trabalho tem como objetivo apresentar uma proposta na ?rea computacional capaz de processar dados meteorol?gicos agregando controle de qualidade a longas s?ries hist?ricas de dados em hidrologia. Os artefatos deste trabalho s?o baseados na vis?o da e-Science, utilizando workflows cient?ficos em ambientes de processamento de alto desempenho que tem por finalidade automatizar parte das etapas de pesquisas cient?ficas em meteorologia. Al?m disso, este trabalho prop?e a integra??o de workflows cient?ficos desenvolvidos na plataforma VisTrails com a computa??o paralela em ambientes GPU utilizando c?digos CUDA. Essa integra??o visa ampliar a capacidade de manipula??o de grandes volumes de dados hidrol?gicos. Outra caracter?stica desse trabalho s?o a apresenta??o dos ganhos de desempenho da solu??o computacional e a representa??o dos dados relativos ? proveni?ncia retrospectiva dos experimentos segundo os moldes da especifica??o PROV-DM. Como um dos principais resultados temos o ?ndice de identifica??o e corre??o de falhas de 87,7%, nos testes realizados com 77 esta??es, o que representa um ganho precioso de tempo na prepara??o de dados nas pesquisas da ?rea. Com isso pode-se concluir que a combina??o da vis?o da e-Ci?ncia associada a tecnologia de computa??o paralela CUDA, al?m de vi?vel, se torna uma alternativa no tratamento de grandes volumes de dados na ?rea de Meteorologia e Climatologia.Submitted by Jorge Silva (jorgelmsilva@ufrrj.br) on 2019-11-28T19:55:31Z No. of bitstreams: 1 2014 - F?bio Cardozo da Silva.pdf: 2429209 bytes, checksum: 16885cae90a97ecd6143fa286cc437e5 (MD5)Made available in DSpace on 2019-11-28T19:55:31Z (GMT). No. of bitstreams: 1 2014 - F?bio Cardozo da Silva.pdf: 2429209 bytes, checksum: 16885cae90a97ecd6143fa286cc437e5 (MD5) Previous issue date: 2014-09-18application/pdfhttps://tede.ufrrj.br/retrieve/11543/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/16888/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/23202/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/29578/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/35952/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/42348/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/48730/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpghttps://tede.ufrrj.br/retrieve/55180/2014%20-%20F%c3%a1bio%20Cardozo%20da%20Silva.pdf.jpgporUniversidade Federal Rural do Rio de JaneiroPrograma de P?s-Gradua??o em Modelagem Matem?tica e ComputacionalUFRRJBrasilInstituto de Ci?ncias ExatasMeteorologiaClimatologiae-Ci?nciaProveni?nciaWorkflows Cient?ficosHidrologiaComputa??o paralelaMeteorologyClimatologye-ScienceProvenanceScientific WorkflowsHidrologParalel ComputingMatem?ticaTratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPUinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisinfo:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFRRJinstname:Universidade Federal Rural do Rio de Janeiro (UFRRJ)instacron:UFRRJTHUMBNAIL2014 - F?bio Cardozo da Silva.pdf.jpg2014 - F?bio Cardozo da Silva.pdf.jpgimage/jpeg1943http://localhost:8080/tede/bitstream/jspui/3124/18/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf.jpgcc73c4c239a4c332d642ba1e7c7a9fb2MD518TEXT2014 - F?bio Cardozo da Silva.pdf.txt2014 - F?bio Cardozo da Silva.pdf.txttext/plain114426http://localhost:8080/tede/bitstream/jspui/3124/17/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf.txt4cdb4cf80bc1f7f0aab0a9d1b565d149MD517ORIGINAL2014 - F?bio Cardozo da Silva.pdf2014 - F?bio Cardozo da Silva.pdfapplication/pdf2429209http://localhost:8080/tede/bitstream/jspui/3124/2/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf16885cae90a97ecd6143fa286cc437e5MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-82089http://localhost:8080/tede/bitstream/jspui/3124/1/license.txt7b5ba3d2445355f386edab96125d42b7MD51jspui/31242022-02-10 11:45:57.165oai:localhost:jspui/3124Tk9UQTogQ09MT1FVRSBBUVVJIEEgU1VBIFBSP1BSSUEgTElDRU4/QQpFc3RhIGxpY2VuP2EgZGUgZXhlbXBsbyA/IGZvcm5lY2lkYSBhcGVuYXMgcGFyYSBmaW5zIGluZm9ybWF0aXZvcy4KCkxJQ0VOP0EgREUgRElTVFJJQlVJPz9PIE4/Ty1FWENMVVNJVkEKCkNvbSBhIGFwcmVzZW50YT8/byBkZXN0YSBsaWNlbj9hLCB2b2M/IChvIGF1dG9yIChlcykgb3UgbyB0aXR1bGFyIGRvcyBkaXJlaXRvcyBkZSBhdXRvcikgY29uY2VkZSA/IFVuaXZlcnNpZGFkZSAKWFhYIChTaWdsYSBkYSBVbml2ZXJzaWRhZGUpIG8gZGlyZWl0byBuP28tZXhjbHVzaXZvIGRlIHJlcHJvZHV6aXIsICB0cmFkdXppciAoY29uZm9ybWUgZGVmaW5pZG8gYWJhaXhvKSwgZS9vdSAKZGlzdHJpYnVpciBhIHN1YSB0ZXNlIG91IGRpc3NlcnRhPz9vIChpbmNsdWluZG8gbyByZXN1bW8pIHBvciB0b2RvIG8gbXVuZG8gbm8gZm9ybWF0byBpbXByZXNzbyBlIGVsZXRyP25pY28gZSAKZW0gcXVhbHF1ZXIgbWVpbywgaW5jbHVpbmRvIG9zIGZvcm1hdG9zID91ZGlvIG91IHY/ZGVvLgoKVm9jPyBjb25jb3JkYSBxdWUgYSBTaWdsYSBkZSBVbml2ZXJzaWRhZGUgcG9kZSwgc2VtIGFsdGVyYXIgbyBjb250ZT9kbywgdHJhbnNwb3IgYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YT8/byAKcGFyYSBxdWFscXVlciBtZWlvIG91IGZvcm1hdG8gcGFyYSBmaW5zIGRlIHByZXNlcnZhPz9vLgoKVm9jPyB0YW1iP20gY29uY29yZGEgcXVlIGEgU2lnbGEgZGUgVW5pdmVyc2lkYWRlIHBvZGUgbWFudGVyIG1haXMgZGUgdW1hIGM/cGlhIGEgc3VhIHRlc2Ugb3UgCmRpc3NlcnRhPz9vIHBhcmEgZmlucyBkZSBzZWd1cmFuP2EsIGJhY2stdXAgZSBwcmVzZXJ2YT8/by4KClZvYz8gZGVjbGFyYSBxdWUgYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YT8/byA/IG9yaWdpbmFsIGUgcXVlIHZvYz8gdGVtIG8gcG9kZXIgZGUgY29uY2VkZXIgb3MgZGlyZWl0b3MgY29udGlkb3MgCm5lc3RhIGxpY2VuP2EuIFZvYz8gdGFtYj9tIGRlY2xhcmEgcXVlIG8gZGVwP3NpdG8gZGEgc3VhIHRlc2Ugb3UgZGlzc2VydGE/P28gbj9vLCBxdWUgc2VqYSBkZSBzZXUgCmNvbmhlY2ltZW50bywgaW5mcmluZ2UgZGlyZWl0b3MgYXV0b3JhaXMgZGUgbmluZ3U/bS4KCkNhc28gYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YT8/byBjb250ZW5oYSBtYXRlcmlhbCBxdWUgdm9jPyBuP28gcG9zc3VpIGEgdGl0dWxhcmlkYWRlIGRvcyBkaXJlaXRvcyBhdXRvcmFpcywgdm9jPyAKZGVjbGFyYSBxdWUgb2J0ZXZlIGEgcGVybWlzcz9vIGlycmVzdHJpdGEgZG8gZGV0ZW50b3IgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIHBhcmEgY29uY2VkZXIgPyBTaWdsYSBkZSBVbml2ZXJzaWRhZGUgCm9zIGRpcmVpdG9zIGFwcmVzZW50YWRvcyBuZXN0YSBsaWNlbj9hLCBlIHF1ZSBlc3NlIG1hdGVyaWFsIGRlIHByb3ByaWVkYWRlIGRlIHRlcmNlaXJvcyBlc3Q/IGNsYXJhbWVudGUgCmlkZW50aWZpY2FkbyBlIHJlY29uaGVjaWRvIG5vIHRleHRvIG91IG5vIGNvbnRlP2RvIGRhIHRlc2Ugb3UgZGlzc2VydGE/P28gb3JhIGRlcG9zaXRhZGEuCgpDQVNPIEEgVEVTRSBPVSBESVNTRVJUQT8/TyBPUkEgREVQT1NJVEFEQSBURU5IQSBTSURPIFJFU1VMVEFETyBERSBVTSBQQVRST0M/TklPIE9VIApBUE9JTyBERSBVTUEgQUc/TkNJQSBERSBGT01FTlRPIE9VIE9VVFJPIE9SR0FOSVNNTyBRVUUgTj9PIFNFSkEgQSBTSUdMQSBERSAKVU5JVkVSU0lEQURFLCBWT0M/IERFQ0xBUkEgUVVFIFJFU1BFSVRPVSBUT0RPUyBFIFFVQUlTUVVFUiBESVJFSVRPUyBERSBSRVZJUz9PIENPTU8gClRBTUI/TSBBUyBERU1BSVMgT0JSSUdBPz9FUyBFWElHSURBUyBQT1IgQ09OVFJBVE8gT1UgQUNPUkRPLgoKQSBTaWdsYSBkZSBVbml2ZXJzaWRhZGUgc2UgY29tcHJvbWV0ZSBhIGlkZW50aWZpY2FyIGNsYXJhbWVudGUgbyBzZXUgbm9tZSAocykgb3UgbyhzKSBub21lKHMpIGRvKHMpIApkZXRlbnRvcihlcykgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIGRhIHRlc2Ugb3UgZGlzc2VydGE/P28sIGUgbj9vIGZhcj8gcXVhbHF1ZXIgYWx0ZXJhPz9vLCBhbD9tIGRhcXVlbGFzIApjb25jZWRpZGFzIHBvciBlc3RhIGxpY2VuP2EuCg==Biblioteca Digital de Teses e Dissertaçõeshttps://tede.ufrrj.br/PUBhttps://tede.ufrrj.br/oai/requestbibliot@ufrrj.br||bibliot@ufrrj.bropendoar:2022-02-10T13:45:57Biblioteca Digital de Teses e Dissertações da UFRRJ - Universidade Federal Rural do Rio de Janeiro (UFRRJ)false |
dc.title.por.fl_str_mv |
Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU |
title |
Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU |
spellingShingle |
Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU Silva, F?bio Cardozo da Meteorologia Climatologia e-Ci?ncia Proveni?ncia Workflows Cient?ficos Hidrologia Computa??o paralela Meteorology Climatology e-Science Provenance Scientific Workflows Hidrolog Paralel Computing Matem?tica |
title_short |
Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU |
title_full |
Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU |
title_fullStr |
Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU |
title_full_unstemmed |
Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU |
title_sort |
Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU |
author |
Silva, F?bio Cardozo da |
author_facet |
Silva, F?bio Cardozo da |
author_role |
author |
dc.contributor.advisor1.fl_str_mv |
Cruz, S?rgio Manuel Serra da |
dc.contributor.advisor1ID.fl_str_mv |
848.488.637-91 |
dc.contributor.advisor-co1.fl_str_mv |
Vieira, Priscila Machado Lima |
dc.contributor.referee1.fl_str_mv |
Cruz, S?rgio Manuel Serra da |
dc.contributor.referee2.fl_str_mv |
Goldschmidt, Ronaldo Ribeiro |
dc.contributor.referee3.fl_str_mv |
Lyra, Gustavo Bastos |
dc.contributor.authorID.fl_str_mv |
082.278.207-35 |
dc.contributor.authorLattes.fl_str_mv |
http://lattes.cnpq.br/2034219453382798 |
dc.contributor.author.fl_str_mv |
Silva, F?bio Cardozo da |
contributor_str_mv |
Cruz, S?rgio Manuel Serra da Vieira, Priscila Machado Lima Cruz, S?rgio Manuel Serra da Goldschmidt, Ronaldo Ribeiro Lyra, Gustavo Bastos |
dc.subject.por.fl_str_mv |
Meteorologia Climatologia e-Ci?ncia Proveni?ncia Workflows Cient?ficos Hidrologia Computa??o paralela |
topic |
Meteorologia Climatologia e-Ci?ncia Proveni?ncia Workflows Cient?ficos Hidrologia Computa??o paralela Meteorology Climatology e-Science Provenance Scientific Workflows Hidrolog Paralel Computing Matem?tica |
dc.subject.eng.fl_str_mv |
Meteorology Climatology e-Science Provenance Scientific Workflows Hidrolog Paralel Computing |
dc.subject.cnpq.fl_str_mv |
Matem?tica |
description |
Despite of the growing importance of researches in the field of Meteorology, especially those that handle large volumes of data focused on studies of hidrological resources, difficulties the handle datasets are increasing. Researchers are developing great efforts to obtain and store high quality data in their repositories. This dissertation aims to present a computational proposal capable to compute meteorological data and add quality control to long times series of data. The artifacts conceived and developed in this work are based on the e-Science vision. We used high performance processing features and scientific workflows to aid to automate the process of scientific research in Meteorology. Furthermore, this work integrates VisTrails scientific workflows with parallel computing environments using GPU and CUDA programming. The integration was guided to extend the capability of handling large volumes of hihg quality meteorological data. Other features of this work are the discussions about performance gains of the proposal and the representation of (raw and curated) data and retrospective provenance generated by the computational experiments according to PROV-DM specification. The main results of this work are. 87,7% of detection of errors and failures replacemente were achieved using 77 meteorological stations. We can conclude that the fusion of E-Sceince vision with CUDA parallel computing approach is viable to deal with large volumes of meterological and climatological data. |
publishDate |
2014 |
dc.date.issued.fl_str_mv |
2014-09-18 |
dc.date.accessioned.fl_str_mv |
2019-11-28T19:55:31Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/masterThesis |
format |
masterThesis |
status_str |
publishedVersion |
dc.identifier.citation.fl_str_mv |
SILVA, F?bio Cardozo da. Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU. 2014. 53 f. Disserta??o (Mestrado em Modelagem Matem?tica e Computacional). Instituto de Ci?ncias Exatas, Universidade Federal Rural do Rio de Janeiro, Serop?dica, RJ, 2014. |
dc.identifier.uri.fl_str_mv |
https://tede.ufrrj.br/jspui/handle/jspui/3124 |
identifier_str_mv |
SILVA, F?bio Cardozo da. Tratamento e preenchimento de falhas de s?ries de dados meteorol?gicos utilizando workflows cient?ficos paralelos em ambientes de GPU. 2014. 53 f. Disserta??o (Mestrado em Modelagem Matem?tica e Computacional). Instituto de Ci?ncias Exatas, Universidade Federal Rural do Rio de Janeiro, Serop?dica, RJ, 2014. |
url |
https://tede.ufrrj.br/jspui/handle/jspui/3124 |
dc.language.iso.fl_str_mv |
por |
language |
por |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
Universidade Federal Rural do Rio de Janeiro |
dc.publisher.program.fl_str_mv |
Programa de P?s-Gradua??o em Modelagem Matem?tica e Computacional |
dc.publisher.initials.fl_str_mv |
UFRRJ |
dc.publisher.country.fl_str_mv |
Brasil |
dc.publisher.department.fl_str_mv |
Instituto de Ci?ncias Exatas |
publisher.none.fl_str_mv |
Universidade Federal Rural do Rio de Janeiro |
dc.source.none.fl_str_mv |
reponame:Biblioteca Digital de Teses e Dissertações da UFRRJ instname:Universidade Federal Rural do Rio de Janeiro (UFRRJ) instacron:UFRRJ |
instname_str |
Universidade Federal Rural do Rio de Janeiro (UFRRJ) |
instacron_str |
UFRRJ |
institution |
UFRRJ |
reponame_str |
Biblioteca Digital de Teses e Dissertações da UFRRJ |
collection |
Biblioteca Digital de Teses e Dissertações da UFRRJ |
bitstream.url.fl_str_mv |
http://localhost:8080/tede/bitstream/jspui/3124/18/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf.jpg http://localhost:8080/tede/bitstream/jspui/3124/17/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf.txt http://localhost:8080/tede/bitstream/jspui/3124/2/2014+-+F%C3%A1bio+Cardozo+da+Silva.pdf http://localhost:8080/tede/bitstream/jspui/3124/1/license.txt |
bitstream.checksum.fl_str_mv |
cc73c4c239a4c332d642ba1e7c7a9fb2 4cdb4cf80bc1f7f0aab0a9d1b565d149 16885cae90a97ecd6143fa286cc437e5 7b5ba3d2445355f386edab96125d42b7 |
bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 MD5 |
repository.name.fl_str_mv |
Biblioteca Digital de Teses e Dissertações da UFRRJ - Universidade Federal Rural do Rio de Janeiro (UFRRJ) |
repository.mail.fl_str_mv |
bibliot@ufrrj.br||bibliot@ufrrj.br |
_version_ |
1800313494739877888 |