A novel cloud and fog-based architecture to support spatial analytics in smart cities

Detalhes bibliográficos
Autor(a) principal: João Paulo Clarindo dos Santos
Data de Publicação: 2021
Tipo de documento: Dissertação
Idioma: eng
Título da fonte: Biblioteca Digital de Teses e Dissertações da USP
Texto Completo: https://doi.org/10.11606/D.55.2021.tde-21012022-170246
Resumo: Providing an infrastructure to accommodate a large number of people in cities is a major challenge for public authorities and private companies. Thereby, the concept of smart cities emerged, which use technologies like sensors and Internet of Things (IoT) devices to aid in urban growth. These devices generate spatial data that can be used for spatial analytics by smart city managers to improve the populations quality of life. However, these IoT devices quickly generate a large volume of spatial data, causing big data problems. A smart city manager can benefit from using concepts such as fog computing, spatial data warehouses, data lakes, and parallel and distributed storage and processing environments to handle this massive amount of data. Based on a systematic review, there are no studies in the literature that consider all of these concepts in the context of smart cities. Therefore, we propose a novel architecture that aims smart city managers in spatial analytics. This architecture is composed of four layers: (i) terminal, which consists of a network of IoT devices; (ii) fog computing, which contains data lakes for real-time data processing; (iii) cloud computing, in which spatial data warehouses are used to support SOLAP (Spatial Online Analytical Processing) queries carried out in batch; and (iv) analytical tools, which incorporate data visualisation and analysis tools. Furthermore, we introduce a set of guidelines to aid smart cities managers to implement the proposed architecture, by describing and discussing important issues and examples of tools and technologies. The proposed architecture and guidelines were validated through two case studies that use real data generated by IoT devices disposed in smart cities. We investigated the execution of three categories of spatial queries, as well as the execution of queries in the fog, in the cloud, and in both environments. These case studies demonstrated the architectures efficiency and effectiveness to support spatial analytics in the context of smart cities.
id USP_65b7d2d8c0ca7b286c484b0fe684a7fb
oai_identifier_str oai:teses.usp.br:tde-21012022-170246
network_acronym_str USP
network_name_str Biblioteca Digital de Teses e Dissertações da USP
repository_id_str 2721
spelling info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesis A novel cloud and fog-based architecture to support spatial analytics in smart cities Uma nova arquitetura baseada em computação em nuvem e computação em névoa para a análise de dados espaciais em cidades inteligentes 2021-11-16Cristina Dutra de AguiarAndré Carlos Ponce de Leon Ferreira de CarvalhoCarmem Satie HaraDaniel dos Santos KasterJoão Paulo Clarindo dos SantosUniversidade de São PauloCiências da Computação e Matemática ComputacionalUSPBR Cidades inteligentes Computação em névoa Data warehouses espaciais Fog computing IoT IoT Parallel and distributed processing Processamento paralelo e distribuído Smart cities Spatial data warehouses Providing an infrastructure to accommodate a large number of people in cities is a major challenge for public authorities and private companies. Thereby, the concept of smart cities emerged, which use technologies like sensors and Internet of Things (IoT) devices to aid in urban growth. These devices generate spatial data that can be used for spatial analytics by smart city managers to improve the populations quality of life. However, these IoT devices quickly generate a large volume of spatial data, causing big data problems. A smart city manager can benefit from using concepts such as fog computing, spatial data warehouses, data lakes, and parallel and distributed storage and processing environments to handle this massive amount of data. Based on a systematic review, there are no studies in the literature that consider all of these concepts in the context of smart cities. Therefore, we propose a novel architecture that aims smart city managers in spatial analytics. This architecture is composed of four layers: (i) terminal, which consists of a network of IoT devices; (ii) fog computing, which contains data lakes for real-time data processing; (iii) cloud computing, in which spatial data warehouses are used to support SOLAP (Spatial Online Analytical Processing) queries carried out in batch; and (iv) analytical tools, which incorporate data visualisation and analysis tools. Furthermore, we introduce a set of guidelines to aid smart cities managers to implement the proposed architecture, by describing and discussing important issues and examples of tools and technologies. The proposed architecture and guidelines were validated through two case studies that use real data generated by IoT devices disposed in smart cities. We investigated the execution of three categories of spatial queries, as well as the execution of queries in the fog, in the cloud, and in both environments. These case studies demonstrated the architectures efficiency and effectiveness to support spatial analytics in the context of smart cities. Prover uma infraestrutura para acomodar uma grande quantidade de pessoas em cidades tem se mostrado um grande desafio para o poder público e empresas privadas. Logo, surgiu o conceito de cidades inteligentes, que utilizam tecnologias para auxílio no crescimento urbano. Essas tecnologias, que consistem em sensores e dispositivos de internet das coisas (ou Internet of Things, IoT), geram dados espaciais, que podem ser utilizados no auxílio à tomada de decisão por gestores de cidades inteligentes para a melhoria da qualidade de vida da população. Entretanto, esses dispositivos IoT geram um grande volume de dados espaciais, de forma veloz, ocasionando problemas de big data. Um gestor de cidades inteligentes pode se beneficiar com o uso de conceitos como computação em névoa, data warehouses espaciais, data lakes e ambientes de processamento e armazenamento paralelo e distribuído para lidar com esse grande volume de dados e a necessidade de análise voltada à tomada de decisão. Entretanto, com base em uma revisão sistemática, não foram identificados estudos que aplicam todos esses conceitos no contexto de cidades inteligentes. Essa limitação motiva o desenvolvimento desta dissertação de mestrado, na qual são introduzidas as seguintes contribuições. Primeiramente, é proposta uma arquitetura que visa auxiliar gestores de cidades inteligentes no processo analítico de dados espaciais. Essa arquitetura envolve quatro camadas: (i) terminal, que consiste em uma rede de dispositivos IoT; (ii) computação em névoa, que contém data lakes para o processamento de dados em tempo real; (iii) computação em nuvem, na qual são utilizados data warehouses espaciais para prover suporte para consultas Spatial On-line Analytical Processing (SOLAP) em lote; e (iv) ferramentas analíticas, que incorpora ferramentas de visualização e análise dos dados. Além disso, são propostas diretrizes para auxílio na implementação da arquitetura proposta, com discussão de desafios que devem ser investigados e com exemplos de tecnologias e ferramentas que podem ser empregadas. A arquitetura e as diretrizes propostas foram validadas por meio de dois estudos de caso que utilizam dados reais gerados em cidades inteligentes. Nesses estudos de caso, foram investigados a execução de diferentes categorias de consultas espaciais e o processamento de consultas espaciais na névoa, na nuvem ou em ambos os ambientes. Os resultados demonstraram a eficiência e a eficácia da arquitetura e das diretrizes no suporte ao processo analítico de dados espaciais. https://doi.org/10.11606/D.55.2021.tde-21012022-170246info:eu-repo/semantics/openAccessengreponame:Biblioteca Digital de Teses e Dissertações da USPinstname:Universidade de São Paulo (USP)instacron:USP2023-12-21T19:45:21Zoai:teses.usp.br:tde-21012022-170246Biblioteca Digital de Teses e Dissertaçõeshttp://www.teses.usp.br/PUBhttp://www.teses.usp.br/cgi-bin/mtd2br.plvirginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.bropendoar:27212023-12-22T13:04:21.192420Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP)false
dc.title.en.fl_str_mv A novel cloud and fog-based architecture to support spatial analytics in smart cities
dc.title.alternative.pt.fl_str_mv Uma nova arquitetura baseada em computação em nuvem e computação em névoa para a análise de dados espaciais em cidades inteligentes
title A novel cloud and fog-based architecture to support spatial analytics in smart cities
spellingShingle A novel cloud and fog-based architecture to support spatial analytics in smart cities
João Paulo Clarindo dos Santos
title_short A novel cloud and fog-based architecture to support spatial analytics in smart cities
title_full A novel cloud and fog-based architecture to support spatial analytics in smart cities
title_fullStr A novel cloud and fog-based architecture to support spatial analytics in smart cities
title_full_unstemmed A novel cloud and fog-based architecture to support spatial analytics in smart cities
title_sort A novel cloud and fog-based architecture to support spatial analytics in smart cities
author João Paulo Clarindo dos Santos
author_facet João Paulo Clarindo dos Santos
author_role author
dc.contributor.advisor1.fl_str_mv Cristina Dutra de Aguiar
dc.contributor.referee1.fl_str_mv André Carlos Ponce de Leon Ferreira de Carvalho
dc.contributor.referee2.fl_str_mv Carmem Satie Hara
dc.contributor.referee3.fl_str_mv Daniel dos Santos Kaster
dc.contributor.author.fl_str_mv João Paulo Clarindo dos Santos
contributor_str_mv Cristina Dutra de Aguiar
André Carlos Ponce de Leon Ferreira de Carvalho
Carmem Satie Hara
Daniel dos Santos Kaster
description Providing an infrastructure to accommodate a large number of people in cities is a major challenge for public authorities and private companies. Thereby, the concept of smart cities emerged, which use technologies like sensors and Internet of Things (IoT) devices to aid in urban growth. These devices generate spatial data that can be used for spatial analytics by smart city managers to improve the populations quality of life. However, these IoT devices quickly generate a large volume of spatial data, causing big data problems. A smart city manager can benefit from using concepts such as fog computing, spatial data warehouses, data lakes, and parallel and distributed storage and processing environments to handle this massive amount of data. Based on a systematic review, there are no studies in the literature that consider all of these concepts in the context of smart cities. Therefore, we propose a novel architecture that aims smart city managers in spatial analytics. This architecture is composed of four layers: (i) terminal, which consists of a network of IoT devices; (ii) fog computing, which contains data lakes for real-time data processing; (iii) cloud computing, in which spatial data warehouses are used to support SOLAP (Spatial Online Analytical Processing) queries carried out in batch; and (iv) analytical tools, which incorporate data visualisation and analysis tools. Furthermore, we introduce a set of guidelines to aid smart cities managers to implement the proposed architecture, by describing and discussing important issues and examples of tools and technologies. The proposed architecture and guidelines were validated through two case studies that use real data generated by IoT devices disposed in smart cities. We investigated the execution of three categories of spatial queries, as well as the execution of queries in the fog, in the cloud, and in both environments. These case studies demonstrated the architectures efficiency and effectiveness to support spatial analytics in the context of smart cities.
publishDate 2021
dc.date.issued.fl_str_mv 2021-11-16
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://doi.org/10.11606/D.55.2021.tde-21012022-170246
url https://doi.org/10.11606/D.55.2021.tde-21012022-170246
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade de São Paulo
dc.publisher.program.fl_str_mv Ciências da Computação e Matemática Computacional
dc.publisher.initials.fl_str_mv USP
dc.publisher.country.fl_str_mv BR
publisher.none.fl_str_mv Universidade de São Paulo
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações da USP
instname:Universidade de São Paulo (USP)
instacron:USP
instname_str Universidade de São Paulo (USP)
instacron_str USP
institution USP
reponame_str Biblioteca Digital de Teses e Dissertações da USP
collection Biblioteca Digital de Teses e Dissertações da USP
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP)
repository.mail.fl_str_mv virginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.br
_version_ 1794502937767051264