Supporting real-time mobility services with scalable flock pattern mining

Detalhes bibliográficos
Autor(a) principal: LACERDA, Thiago de Barros
Data de Publicação: 2016
Tipo de documento: Dissertação
Idioma: eng
Título da fonte: Repositório Institucional da UFPE
dARK ID: ark:/64986/001300000rjmk
Texto Completo: https://repositorio.ufpe.br/handle/123456789/18700
Resumo: Pattern mining in spatio-temporal datasets is a really relevant subject in the academia and the industry nowadays, due to its wide applicability in helping to solve real-world problems. Many of them can be found in the context of Smart Cities, like Traffic Management, Surveillance and Security and City Planning, to name a few. Among the various spatio-temporal patterns that one can extract from a spatio-temporal dataset, the flock pattern is one that has gained a lot of attention, because of its intrinsic relation with the aforementioned problems. A lot of work has been done in the academia, in order to provide algorithms able to identify the flock pattern. However, none of them could perform that task efficiently nor be able to scale well when a large dataset was the analysis target. Additionally, we found that there was no system architecture proposal that could be simple and modular enough to be used in that spatio-temporal pattern detection problem. Given that context, this dissertation proposes a modular system archicture designed to help solving flock pattern mining problems and possibly be reused to other spatio-temporal mining experiments. We then use such architecture as the infrastructure to implement an efficient flock detection algorithm, aiming at achieving considerable gains in execution time without compromising accuracy, thus targeting real-time deployment and on-line processing in Smart Cities. Last, but not least, we remodel our algorithm in order to take advantage of multi-core architectures present in modern computers. Our results indicate that our proposal outperforms the current state-of-the-art techniques, by achieving 99% CPU time improvement. Moreover, with our multi-thread model, we were able to reduce the processing time of our proposed algorithm by 96% in some cases. We prove the efficiency of our solution by performing evaluation with both real and synthetic large datasets.
id UFPE_4afac38e12861747b3164a7082d1e110
oai_identifier_str oai:repositorio.ufpe.br:123456789/18700
network_acronym_str UFPE
network_name_str Repositório Institucional da UFPE
repository_id_str 2221
spelling LACERDA, Thiago de Barroshttp://lattes.cnpq.br/7268999295640842http://lattes.cnpq.br/8598484164048317FERNANDES, Stênio Flávio de Lacerda2017-05-04T17:26:09Z2017-05-04T17:26:09Z2016-07-29https://repositorio.ufpe.br/handle/123456789/18700ark:/64986/001300000rjmkPattern mining in spatio-temporal datasets is a really relevant subject in the academia and the industry nowadays, due to its wide applicability in helping to solve real-world problems. Many of them can be found in the context of Smart Cities, like Traffic Management, Surveillance and Security and City Planning, to name a few. Among the various spatio-temporal patterns that one can extract from a spatio-temporal dataset, the flock pattern is one that has gained a lot of attention, because of its intrinsic relation with the aforementioned problems. A lot of work has been done in the academia, in order to provide algorithms able to identify the flock pattern. However, none of them could perform that task efficiently nor be able to scale well when a large dataset was the analysis target. Additionally, we found that there was no system architecture proposal that could be simple and modular enough to be used in that spatio-temporal pattern detection problem. Given that context, this dissertation proposes a modular system archicture designed to help solving flock pattern mining problems and possibly be reused to other spatio-temporal mining experiments. We then use such architecture as the infrastructure to implement an efficient flock detection algorithm, aiming at achieving considerable gains in execution time without compromising accuracy, thus targeting real-time deployment and on-line processing in Smart Cities. Last, but not least, we remodel our algorithm in order to take advantage of multi-core architectures present in modern computers. Our results indicate that our proposal outperforms the current state-of-the-art techniques, by achieving 99% CPU time improvement. Moreover, with our multi-thread model, we were able to reduce the processing time of our proposed algorithm by 96% in some cases. We prove the efficiency of our solution by performing evaluation with both real and synthetic large datasets.Detecção de padrões em dados espaço-temporais tem se mostrado um tema de muita relevância nos dias atuais, tanto na academia quanto na indústria, devido a sua vasta aplicabilidade em auxiliar a solucionar problemas enfrentados na sociedade. Muitos desses problemas podem ser classificados no conexto de Cidades Inteligentes (Smart Cities), como Gerenciamento de Tráfego, Segurança e Planejamento de Cidades. Dentre os vários padrões espaço-temporais que podem ser extraídos de uma base de dados, o padrão de flock é um que vem atraindo muita atenção, devido a sua relação intrínseca com os problemas mencionados anteriormente. Muitas pesquisas vêm sendo feitas na academia, visando desenvolver algoritmos capazes de identificar esse padrão de movimentação. Porém, nenhum deles foi capaz de executar tal tarefa eficientemente, nem conseguiu escalar de maneira aceitável quando uma base de dados de grande tamanho foi analisada. Além disso, não foi encontrado nos trabalhos relacionados uma arquitetura de software que conseguisse ser simples e modular o suficiente para ser usada no problema de detecção de padrões de flock em dados espaço-temporais. Com isso em mente, essa dissertação propõe uma arquitetura de software modular, direcionada para solucionar problemas de detecção desse padrão e possivelmente ser utilizada para outros experimentos envolvendo mineração de padrões em dados espaço-temporais. Tal arquitetura foi então usada como base na implementação de um algoritmo de detecção de flock, focando em alcançar grandes ganhos em tempo de processamento, sem comprometer a precisão, visando então cenários de aplicações de tempo real em Cidades Inteligentes. No fim, nós propomos uma remodelagem no nosso algoritmo para poder utilizar ao máximo o poder de processamento oferecido pelas arquiteturas multi-core dos processadores modernos. Nossos resultados mostraram que nossa solução conseguiu superar propostas do estado da arte, alcançando 99% de redução no tempo de processamento total. Além disso, nossa remodelagem multi-thread conseguiu melhorar os resultados da nossa solução em até 96% em alguns casos. A eficiência e performance da nossa proposta foi comprovada com avaliações feitas com bases de dados geradas sinteticamente e coletadas em experimentos reais.engUniversidade Federal de PernambucoPrograma de Pos Graduacao em Ciencia da ComputacaoUFPEBrasilAttribution-NonCommercial-NoDerivs 3.0 Brazilhttp://creativecommons.org/licenses/by-nc-nd/3.0/br/info:eu-repo/semantics/openAccessas-chave: CidadesInteligentes. MineraçãodePadrões. DadosEspaço-temporais. Padrão de Flock.SmartCities. PatternMining. Spatio-temporaldata. FlockPattern.Supporting real-time mobility services with scalable flock pattern mininginfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesismestradoreponame:Repositório Institucional da UFPEinstname:Universidade Federal de Pernambuco (UFPE)instacron:UFPETHUMBNAILThiagoLacerda_dissertacao_CD.pdf.jpgThiagoLacerda_dissertacao_CD.pdf.jpgGenerated Thumbnailimage/jpeg1275https://repositorio.ufpe.br/bitstream/123456789/18700/5/ThiagoLacerda_dissertacao_CD.pdf.jpg07cff7aedeaa66f908a3ec991327916cMD55ORIGINALThiagoLacerda_dissertacao_CD.pdfThiagoLacerda_dissertacao_CD.pdfapplication/pdf3710836https://repositorio.ufpe.br/bitstream/123456789/18700/1/ThiagoLacerda_dissertacao_CD.pdf28f0e32dde464cdfd59c89964029a739MD51CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-81232https://repositorio.ufpe.br/bitstream/123456789/18700/2/license_rdf66e71c371cc565284e70f40736c94386MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-82311https://repositorio.ufpe.br/bitstream/123456789/18700/3/license.txt4b8a02c7f2818eaf00dcf2260dd5eb08MD53TEXTThiagoLacerda_dissertacao_CD.pdf.txtThiagoLacerda_dissertacao_CD.pdf.txtExtracted texttext/plain122982https://repositorio.ufpe.br/bitstream/123456789/18700/4/ThiagoLacerda_dissertacao_CD.pdf.txtd8e3e7419ce10efb861f8f4306bdb6d5MD54123456789/187002019-10-25 04:16:52.487oai:repositorio.ufpe.br:123456789/18700TGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmEKClRvZG8gZGVwb3NpdGFudGUgZGUgbWF0ZXJpYWwgbm8gUmVwb3NpdMOzcmlvIEluc3RpdHVjaW9uYWwgKFJJKSBkZXZlIGNvbmNlZGVyLCDDoCBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkZSBQZXJuYW1idWNvIChVRlBFKSwgdW1hIExpY2Vuw6dhIGRlIERpc3RyaWJ1acOnw6NvIE7Do28gRXhjbHVzaXZhIHBhcmEgbWFudGVyIGUgdG9ybmFyIGFjZXNzw612ZWlzIG9zIHNldXMgZG9jdW1lbnRvcywgZW0gZm9ybWF0byBkaWdpdGFsLCBuZXN0ZSByZXBvc2l0w7NyaW8uCgpDb20gYSBjb25jZXNzw6NvIGRlc3RhIGxpY2Vuw6dhIG7Do28gZXhjbHVzaXZhLCBvIGRlcG9zaXRhbnRlIG1hbnTDqW0gdG9kb3Mgb3MgZGlyZWl0b3MgZGUgYXV0b3IuCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwoKTGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmEKCkFvIGNvbmNvcmRhciBjb20gZXN0YSBsaWNlbsOnYSBlIGFjZWl0w6EtbGEsIHZvY8OqIChhdXRvciBvdSBkZXRlbnRvciBkb3MgZGlyZWl0b3MgYXV0b3JhaXMpOgoKYSkgRGVjbGFyYSBxdWUgY29uaGVjZSBhIHBvbMOtdGljYSBkZSBjb3B5cmlnaHQgZGEgZWRpdG9yYSBkbyBzZXUgZG9jdW1lbnRvOwpiKSBEZWNsYXJhIHF1ZSBjb25oZWNlIGUgYWNlaXRhIGFzIERpcmV0cml6ZXMgcGFyYSBvIFJlcG9zaXTDs3JpbyBJbnN0aXR1Y2lvbmFsIGRhIFVGUEU7CmMpIENvbmNlZGUgw6AgVUZQRSBvIGRpcmVpdG8gbsOjbyBleGNsdXNpdm8gZGUgYXJxdWl2YXIsIHJlcHJvZHV6aXIsIGNvbnZlcnRlciAoY29tbyBkZWZpbmlkbyBhIHNlZ3VpciksIGNvbXVuaWNhciBlL291IGRpc3RyaWJ1aXIsIG5vIFJJLCBvIGRvY3VtZW50byBlbnRyZWd1ZSAoaW5jbHVpbmRvIG8gcmVzdW1vL2Fic3RyYWN0KSBlbSBmb3JtYXRvIGRpZ2l0YWwgb3UgcG9yIG91dHJvIG1laW87CmQpIERlY2xhcmEgcXVlIGF1dG9yaXphIGEgVUZQRSBhIGFycXVpdmFyIG1haXMgZGUgdW1hIGPDs3BpYSBkZXN0ZSBkb2N1bWVudG8gZSBjb252ZXJ0w6otbG8sIHNlbSBhbHRlcmFyIG8gc2V1IGNvbnRlw7pkbywgcGFyYSBxdWFscXVlciBmb3JtYXRvIGRlIGZpY2hlaXJvLCBtZWlvIG91IHN1cG9ydGUsIHBhcmEgZWZlaXRvcyBkZSBzZWd1cmFuw6dhLCBwcmVzZXJ2YcOnw6NvIChiYWNrdXApIGUgYWNlc3NvOwplKSBEZWNsYXJhIHF1ZSBvIGRvY3VtZW50byBzdWJtZXRpZG8gw6kgbyBzZXUgdHJhYmFsaG8gb3JpZ2luYWwgZSBxdWUgZGV0w6ltIG8gZGlyZWl0byBkZSBjb25jZWRlciBhIHRlcmNlaXJvcyBvcyBkaXJlaXRvcyBjb250aWRvcyBuZXN0YSBsaWNlbsOnYS4gRGVjbGFyYSB0YW1iw6ltIHF1ZSBhIGVudHJlZ2EgZG8gZG9jdW1lbnRvIG7Do28gaW5mcmluZ2Ugb3MgZGlyZWl0b3MgZGUgb3V0cmEgcGVzc29hIG91IGVudGlkYWRlOwpmKSBEZWNsYXJhIHF1ZSwgbm8gY2FzbyBkbyBkb2N1bWVudG8gc3VibWV0aWRvIGNvbnRlciBtYXRlcmlhbCBkbyBxdWFsIG7Do28gZGV0w6ltIG9zIGRpcmVpdG9zIGRlCmF1dG9yLCBvYnRldmUgYSBhdXRvcml6YcOnw6NvIGlycmVzdHJpdGEgZG8gcmVzcGVjdGl2byBkZXRlbnRvciBkZXNzZXMgZGlyZWl0b3MgcGFyYSBjZWRlciDDoApVRlBFIG9zIGRpcmVpdG9zIHJlcXVlcmlkb3MgcG9yIGVzdGEgTGljZW7Dp2EgZSBhdXRvcml6YXIgYSB1bml2ZXJzaWRhZGUgYSB1dGlsaXrDoS1sb3MgbGVnYWxtZW50ZS4gRGVjbGFyYSB0YW1iw6ltIHF1ZSBlc3NlIG1hdGVyaWFsIGN1am9zIGRpcmVpdG9zIHPDo28gZGUgdGVyY2Vpcm9zIGVzdMOhIGNsYXJhbWVudGUgaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3UgY29udGXDumRvIGRvIGRvY3VtZW50byBlbnRyZWd1ZTsKZykgU2UgbyBkb2N1bWVudG8gZW50cmVndWUgw6kgYmFzZWFkbyBlbSB0cmFiYWxobyBmaW5hbmNpYWRvIG91IGFwb2lhZG8gcG9yIG91dHJhIGluc3RpdHVpw6fDo28gcXVlIG7Do28gYSBVRlBFLMKgZGVjbGFyYSBxdWUgY3VtcHJpdSBxdWFpc3F1ZXIgb2JyaWdhw6fDtWVzIGV4aWdpZGFzIHBlbG8gcmVzcGVjdGl2byBjb250cmF0byBvdSBhY29yZG8uCgpBIFVGUEUgaWRlbnRpZmljYXLDoSBjbGFyYW1lbnRlIG8ocykgbm9tZShzKSBkbyhzKSBhdXRvciAoZXMpIGRvcyBkaXJlaXRvcyBkbyBkb2N1bWVudG8gZW50cmVndWUgZSBuw6NvIGZhcsOhIHF1YWxxdWVyIGFsdGVyYcOnw6NvLCBwYXJhIGFsw6ltIGRvIHByZXZpc3RvIG5hIGFsw61uZWEgYykuCg==Repositório InstitucionalPUBhttps://repositorio.ufpe.br/oai/requestattena@ufpe.bropendoar:22212019-10-25T07:16:52Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)false
dc.title.pt_BR.fl_str_mv Supporting real-time mobility services with scalable flock pattern mining
title Supporting real-time mobility services with scalable flock pattern mining
spellingShingle Supporting real-time mobility services with scalable flock pattern mining
LACERDA, Thiago de Barros
as-chave: CidadesInteligentes. MineraçãodePadrões. DadosEspaço-temporais. Padrão de Flock.
SmartCities. PatternMining. Spatio-temporaldata. FlockPattern.
title_short Supporting real-time mobility services with scalable flock pattern mining
title_full Supporting real-time mobility services with scalable flock pattern mining
title_fullStr Supporting real-time mobility services with scalable flock pattern mining
title_full_unstemmed Supporting real-time mobility services with scalable flock pattern mining
title_sort Supporting real-time mobility services with scalable flock pattern mining
author LACERDA, Thiago de Barros
author_facet LACERDA, Thiago de Barros
author_role author
dc.contributor.authorLattes.pt_BR.fl_str_mv http://lattes.cnpq.br/7268999295640842
dc.contributor.advisorLattes.pt_BR.fl_str_mv http://lattes.cnpq.br/8598484164048317
dc.contributor.author.fl_str_mv LACERDA, Thiago de Barros
dc.contributor.advisor1.fl_str_mv FERNANDES, Stênio Flávio de Lacerda
contributor_str_mv FERNANDES, Stênio Flávio de Lacerda
dc.subject.por.fl_str_mv as-chave: CidadesInteligentes. MineraçãodePadrões. DadosEspaço-temporais. Padrão de Flock.
SmartCities. PatternMining. Spatio-temporaldata. FlockPattern.
topic as-chave: CidadesInteligentes. MineraçãodePadrões. DadosEspaço-temporais. Padrão de Flock.
SmartCities. PatternMining. Spatio-temporaldata. FlockPattern.
description Pattern mining in spatio-temporal datasets is a really relevant subject in the academia and the industry nowadays, due to its wide applicability in helping to solve real-world problems. Many of them can be found in the context of Smart Cities, like Traffic Management, Surveillance and Security and City Planning, to name a few. Among the various spatio-temporal patterns that one can extract from a spatio-temporal dataset, the flock pattern is one that has gained a lot of attention, because of its intrinsic relation with the aforementioned problems. A lot of work has been done in the academia, in order to provide algorithms able to identify the flock pattern. However, none of them could perform that task efficiently nor be able to scale well when a large dataset was the analysis target. Additionally, we found that there was no system architecture proposal that could be simple and modular enough to be used in that spatio-temporal pattern detection problem. Given that context, this dissertation proposes a modular system archicture designed to help solving flock pattern mining problems and possibly be reused to other spatio-temporal mining experiments. We then use such architecture as the infrastructure to implement an efficient flock detection algorithm, aiming at achieving considerable gains in execution time without compromising accuracy, thus targeting real-time deployment and on-line processing in Smart Cities. Last, but not least, we remodel our algorithm in order to take advantage of multi-core architectures present in modern computers. Our results indicate that our proposal outperforms the current state-of-the-art techniques, by achieving 99% CPU time improvement. Moreover, with our multi-thread model, we were able to reduce the processing time of our proposed algorithm by 96% in some cases. We prove the efficiency of our solution by performing evaluation with both real and synthetic large datasets.
publishDate 2016
dc.date.issued.fl_str_mv 2016-07-29
dc.date.accessioned.fl_str_mv 2017-05-04T17:26:09Z
dc.date.available.fl_str_mv 2017-05-04T17:26:09Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://repositorio.ufpe.br/handle/123456789/18700
dc.identifier.dark.fl_str_mv ark:/64986/001300000rjmk
url https://repositorio.ufpe.br/handle/123456789/18700
identifier_str_mv ark:/64986/001300000rjmk
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de Pernambuco
dc.publisher.program.fl_str_mv Programa de Pos Graduacao em Ciencia da Computacao
dc.publisher.initials.fl_str_mv UFPE
dc.publisher.country.fl_str_mv Brasil
publisher.none.fl_str_mv Universidade Federal de Pernambuco
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFPE
instname:Universidade Federal de Pernambuco (UFPE)
instacron:UFPE
instname_str Universidade Federal de Pernambuco (UFPE)
instacron_str UFPE
institution UFPE
reponame_str Repositório Institucional da UFPE
collection Repositório Institucional da UFPE
bitstream.url.fl_str_mv https://repositorio.ufpe.br/bitstream/123456789/18700/5/ThiagoLacerda_dissertacao_CD.pdf.jpg
https://repositorio.ufpe.br/bitstream/123456789/18700/1/ThiagoLacerda_dissertacao_CD.pdf
https://repositorio.ufpe.br/bitstream/123456789/18700/2/license_rdf
https://repositorio.ufpe.br/bitstream/123456789/18700/3/license.txt
https://repositorio.ufpe.br/bitstream/123456789/18700/4/ThiagoLacerda_dissertacao_CD.pdf.txt
bitstream.checksum.fl_str_mv 07cff7aedeaa66f908a3ec991327916c
28f0e32dde464cdfd59c89964029a739
66e71c371cc565284e70f40736c94386
4b8a02c7f2818eaf00dcf2260dd5eb08
d8e3e7419ce10efb861f8f4306bdb6d5
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)
repository.mail.fl_str_mv attena@ufpe.br
_version_ 1815172896416333824