A novel cloud and fog-based architecture to support spatial analytics in smart cities

Detalhes bibliográficos
Autor(a) principal: Santos, João Paulo Clarindo dos
Data de Publicação: 2021
Tipo de documento: Dissertação
Idioma: eng
Título da fonte: Biblioteca Digital de Teses e Dissertações da USP
Texto Completo: https://www.teses.usp.br/teses/disponiveis/55/55134/tde-21012022-170246/
Resumo: Providing an infrastructure to accommodate a large number of people in cities is a major challenge for public authorities and private companies. Thereby, the concept of smart cities emerged, which use technologies like sensors and Internet of Things (IoT) devices to aid in urban growth. These devices generate spatial data that can be used for spatial analytics by smart city managers to improve the populations quality of life. However, these IoT devices quickly generate a large volume of spatial data, causing big data problems. A smart city manager can benefit from using concepts such as fog computing, spatial data warehouses, data lakes, and parallel and distributed storage and processing environments to handle this massive amount of data. Based on a systematic review, there are no studies in the literature that consider all of these concepts in the context of smart cities. Therefore, we propose a novel architecture that aims smart city managers in spatial analytics. This architecture is composed of four layers: (i) terminal, which consists of a network of IoT devices; (ii) fog computing, which contains data lakes for real-time data processing; (iii) cloud computing, in which spatial data warehouses are used to support SOLAP (Spatial Online Analytical Processing) queries carried out in batch; and (iv) analytical tools, which incorporate data visualisation and analysis tools. Furthermore, we introduce a set of guidelines to aid smart cities managers to implement the proposed architecture, by describing and discussing important issues and examples of tools and technologies. The proposed architecture and guidelines were validated through two case studies that use real data generated by IoT devices disposed in smart cities. We investigated the execution of three categories of spatial queries, as well as the execution of queries in the fog, in the cloud, and in both environments. These case studies demonstrated the architectures efficiency and effectiveness to support spatial analytics in the context of smart cities.
id USP_65b7d2d8c0ca7b286c484b0fe684a7fb
oai_identifier_str oai:teses.usp.br:tde-21012022-170246
network_acronym_str USP
network_name_str Biblioteca Digital de Teses e Dissertações da USP
repository_id_str 2721
spelling A novel cloud and fog-based architecture to support spatial analytics in smart citiesUma nova arquitetura baseada em computação em nuvem e computação em névoa para a análise de dados espaciais em cidades inteligentesCidades inteligentesComputação em névoaData warehouses espaciaisFog computingIoTIoTParallel and distributed processingProcessamento paralelo e distribuídoSmart citiesSpatial data warehousesProviding an infrastructure to accommodate a large number of people in cities is a major challenge for public authorities and private companies. Thereby, the concept of smart cities emerged, which use technologies like sensors and Internet of Things (IoT) devices to aid in urban growth. These devices generate spatial data that can be used for spatial analytics by smart city managers to improve the populations quality of life. However, these IoT devices quickly generate a large volume of spatial data, causing big data problems. A smart city manager can benefit from using concepts such as fog computing, spatial data warehouses, data lakes, and parallel and distributed storage and processing environments to handle this massive amount of data. Based on a systematic review, there are no studies in the literature that consider all of these concepts in the context of smart cities. Therefore, we propose a novel architecture that aims smart city managers in spatial analytics. This architecture is composed of four layers: (i) terminal, which consists of a network of IoT devices; (ii) fog computing, which contains data lakes for real-time data processing; (iii) cloud computing, in which spatial data warehouses are used to support SOLAP (Spatial Online Analytical Processing) queries carried out in batch; and (iv) analytical tools, which incorporate data visualisation and analysis tools. Furthermore, we introduce a set of guidelines to aid smart cities managers to implement the proposed architecture, by describing and discussing important issues and examples of tools and technologies. The proposed architecture and guidelines were validated through two case studies that use real data generated by IoT devices disposed in smart cities. We investigated the execution of three categories of spatial queries, as well as the execution of queries in the fog, in the cloud, and in both environments. These case studies demonstrated the architectures efficiency and effectiveness to support spatial analytics in the context of smart cities.Prover uma infraestrutura para acomodar uma grande quantidade de pessoas em cidades tem se mostrado um grande desafio para o poder público e empresas privadas. Logo, surgiu o conceito de cidades inteligentes, que utilizam tecnologias para auxílio no crescimento urbano. Essas tecnologias, que consistem em sensores e dispositivos de internet das coisas (ou Internet of Things, IoT), geram dados espaciais, que podem ser utilizados no auxílio à tomada de decisão por gestores de cidades inteligentes para a melhoria da qualidade de vida da população. Entretanto, esses dispositivos IoT geram um grande volume de dados espaciais, de forma veloz, ocasionando problemas de big data. Um gestor de cidades inteligentes pode se beneficiar com o uso de conceitos como computação em névoa, data warehouses espaciais, data lakes e ambientes de processamento e armazenamento paralelo e distribuído para lidar com esse grande volume de dados e a necessidade de análise voltada à tomada de decisão. Entretanto, com base em uma revisão sistemática, não foram identificados estudos que aplicam todos esses conceitos no contexto de cidades inteligentes. Essa limitação motiva o desenvolvimento desta dissertação de mestrado, na qual são introduzidas as seguintes contribuições. Primeiramente, é proposta uma arquitetura que visa auxiliar gestores de cidades inteligentes no processo analítico de dados espaciais. Essa arquitetura envolve quatro camadas: (i) terminal, que consiste em uma rede de dispositivos IoT; (ii) computação em névoa, que contém data lakes para o processamento de dados em tempo real; (iii) computação em nuvem, na qual são utilizados data warehouses espaciais para prover suporte para consultas Spatial On-line Analytical Processing (SOLAP) em lote; e (iv) ferramentas analíticas, que incorpora ferramentas de visualização e análise dos dados. Além disso, são propostas diretrizes para auxílio na implementação da arquitetura proposta, com discussão de desafios que devem ser investigados e com exemplos de tecnologias e ferramentas que podem ser empregadas. A arquitetura e as diretrizes propostas foram validadas por meio de dois estudos de caso que utilizam dados reais gerados em cidades inteligentes. Nesses estudos de caso, foram investigados a execução de diferentes categorias de consultas espaciais e o processamento de consultas espaciais na névoa, na nuvem ou em ambos os ambientes. Os resultados demonstraram a eficiência e a eficácia da arquitetura e das diretrizes no suporte ao processo analítico de dados espaciais.Biblioteca Digitais de Teses e Dissertações da USPAguiar, Cristina Dutra deSantos, João Paulo Clarindo dos2021-11-16info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttps://www.teses.usp.br/teses/disponiveis/55/55134/tde-21012022-170246/reponame:Biblioteca Digital de Teses e Dissertações da USPinstname:Universidade de São Paulo (USP)instacron:USPLiberar o conteúdo para acesso público.info:eu-repo/semantics/openAccesseng2022-01-21T19:12:02Zoai:teses.usp.br:tde-21012022-170246Biblioteca Digital de Teses e Dissertaçõeshttp://www.teses.usp.br/PUBhttp://www.teses.usp.br/cgi-bin/mtd2br.plvirginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.bropendoar:27212022-01-21T19:12:02Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP)false
dc.title.none.fl_str_mv A novel cloud and fog-based architecture to support spatial analytics in smart cities
Uma nova arquitetura baseada em computação em nuvem e computação em névoa para a análise de dados espaciais em cidades inteligentes
title A novel cloud and fog-based architecture to support spatial analytics in smart cities
spellingShingle A novel cloud and fog-based architecture to support spatial analytics in smart cities
Santos, João Paulo Clarindo dos
Cidades inteligentes
Computação em névoa
Data warehouses espaciais
Fog computing
IoT
IoT
Parallel and distributed processing
Processamento paralelo e distribuído
Smart cities
Spatial data warehouses
title_short A novel cloud and fog-based architecture to support spatial analytics in smart cities
title_full A novel cloud and fog-based architecture to support spatial analytics in smart cities
title_fullStr A novel cloud and fog-based architecture to support spatial analytics in smart cities
title_full_unstemmed A novel cloud and fog-based architecture to support spatial analytics in smart cities
title_sort A novel cloud and fog-based architecture to support spatial analytics in smart cities
author Santos, João Paulo Clarindo dos
author_facet Santos, João Paulo Clarindo dos
author_role author
dc.contributor.none.fl_str_mv Aguiar, Cristina Dutra de
dc.contributor.author.fl_str_mv Santos, João Paulo Clarindo dos
dc.subject.por.fl_str_mv Cidades inteligentes
Computação em névoa
Data warehouses espaciais
Fog computing
IoT
IoT
Parallel and distributed processing
Processamento paralelo e distribuído
Smart cities
Spatial data warehouses
topic Cidades inteligentes
Computação em névoa
Data warehouses espaciais
Fog computing
IoT
IoT
Parallel and distributed processing
Processamento paralelo e distribuído
Smart cities
Spatial data warehouses
description Providing an infrastructure to accommodate a large number of people in cities is a major challenge for public authorities and private companies. Thereby, the concept of smart cities emerged, which use technologies like sensors and Internet of Things (IoT) devices to aid in urban growth. These devices generate spatial data that can be used for spatial analytics by smart city managers to improve the populations quality of life. However, these IoT devices quickly generate a large volume of spatial data, causing big data problems. A smart city manager can benefit from using concepts such as fog computing, spatial data warehouses, data lakes, and parallel and distributed storage and processing environments to handle this massive amount of data. Based on a systematic review, there are no studies in the literature that consider all of these concepts in the context of smart cities. Therefore, we propose a novel architecture that aims smart city managers in spatial analytics. This architecture is composed of four layers: (i) terminal, which consists of a network of IoT devices; (ii) fog computing, which contains data lakes for real-time data processing; (iii) cloud computing, in which spatial data warehouses are used to support SOLAP (Spatial Online Analytical Processing) queries carried out in batch; and (iv) analytical tools, which incorporate data visualisation and analysis tools. Furthermore, we introduce a set of guidelines to aid smart cities managers to implement the proposed architecture, by describing and discussing important issues and examples of tools and technologies. The proposed architecture and guidelines were validated through two case studies that use real data generated by IoT devices disposed in smart cities. We investigated the execution of three categories of spatial queries, as well as the execution of queries in the fog, in the cloud, and in both environments. These case studies demonstrated the architectures efficiency and effectiveness to support spatial analytics in the context of smart cities.
publishDate 2021
dc.date.none.fl_str_mv 2021-11-16
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://www.teses.usp.br/teses/disponiveis/55/55134/tde-21012022-170246/
url https://www.teses.usp.br/teses/disponiveis/55/55134/tde-21012022-170246/
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv
dc.rights.driver.fl_str_mv Liberar o conteúdo para acesso público.
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Liberar o conteúdo para acesso público.
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.coverage.none.fl_str_mv
dc.publisher.none.fl_str_mv Biblioteca Digitais de Teses e Dissertações da USP
publisher.none.fl_str_mv Biblioteca Digitais de Teses e Dissertações da USP
dc.source.none.fl_str_mv
reponame:Biblioteca Digital de Teses e Dissertações da USP
instname:Universidade de São Paulo (USP)
instacron:USP
instname_str Universidade de São Paulo (USP)
instacron_str USP
institution USP
reponame_str Biblioteca Digital de Teses e Dissertações da USP
collection Biblioteca Digital de Teses e Dissertações da USP
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP)
repository.mail.fl_str_mv virginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.br
_version_ 1809090951500529664