A Big Data system architecture to support the monitoring of paved roads
Autor(a) principal: | |
---|---|
Data de Publicação: | 2023 |
Outros Autores: | , , , , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | https://hdl.handle.net/1822/89137 |
Resumo: | Today, everything is connected, including the exchange of data and the generation of new information. As a result, large amounts of data are being collected at an ever-increasing rate and in a variety of forms, a phenomenon now known as Big Data. Recent developments in information and communication technologies are driving the generation of significant amounts of data from multiple sources, namely sensors. In response to these technological advances and data challenges, this paper proposes a Big Data system architecture for paved road monitoring and implements part of this architecture on a section of road in Portugal as a case study. The challenge in the case study architecture is to collect and process sensor data in real time, at a rate of 500 records per second, producing 15 GBytes of data per day, using a real-time data stream for real-time monitoring and a batch data stream for deeper analysis. This allows users to obtain instant updates on road conditions such as the number of vehicles, loads, weather, and pavement temperatures on the road. They can monitor what is happening on the road in real time, receive alerts, and even gain insight into historical data, such as analysing the condition of structures or identifying traffic patterns. |
id |
RCAP_4a9cef3dd69466e3b73dd53790228200 |
---|---|
oai_identifier_str |
oai:repositorium.sdum.uminho.pt:1822/89137 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
A Big Data system architecture to support the monitoring of paved roadsBig DataBig Data architecturefibre-optic sensorsmonitor road healthreal-time monitoringbatch monitoringEngenharia e Tecnologia::Outras Engenharias e TecnologiasIndústria, inovação e infraestruturasToday, everything is connected, including the exchange of data and the generation of new information. As a result, large amounts of data are being collected at an ever-increasing rate and in a variety of forms, a phenomenon now known as Big Data. Recent developments in information and communication technologies are driving the generation of significant amounts of data from multiple sources, namely sensors. In response to these technological advances and data challenges, this paper proposes a Big Data system architecture for paved road monitoring and implements part of this architecture on a section of road in Portugal as a case study. The challenge in the case study architecture is to collect and process sensor data in real time, at a rate of 500 records per second, producing 15 GBytes of data per day, using a real-time data stream for real-time monitoring and a batch data stream for deeper analysis. This allows users to obtain instant updates on road conditions such as the number of vehicles, loads, weather, and pavement temperatures on the road. They can monitor what is happening on the road in real time, receive alerts, and even gain insight into historical data, such as analysing the condition of structures or identifying traffic patterns.This work was also partly financed by FCT/MCTES through national funds (PIDDAC) under the R&D Unit Institute for Sustainability and Innovation in Structural Engineering (ISISE), under reference UIDB/04029/2020, and under the Associate Laboratory Advanced Production and Intelligent Systems ARISE, under reference LA/P/0112/2020. This work was also partly supported by the FCT under the R&D Units Project Scope: UIDB/00319/2020.MDPIUniversidade do MinhoOliveira e Sá, JorgeRebelo, Francisco José PereiraSilva, DiogoTeles, GabrielRamos, DiogoRomeu, José2023-11-242023-11-24T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/1822/89137engOliveira e Sá, J.; Rebelo, F.; Silva, D.; Teles, G.; Ramos, D.; Romeu, J. A Big Data System Architecture to Support the Monitoring of Paved Roads. Infrastructures 2023, 8, 167. https://doi.org/10.3390/infrastructures81201672412-381110.3390/infrastructures8120167https://www.mdpi.com/2412-3811/8/12/167info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-03-02T01:19:11Zoai:repositorium.sdum.uminho.pt:1822/89137Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T03:11:42.644335Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
A Big Data system architecture to support the monitoring of paved roads |
title |
A Big Data system architecture to support the monitoring of paved roads |
spellingShingle |
A Big Data system architecture to support the monitoring of paved roads Oliveira e Sá, Jorge Big Data Big Data architecture fibre-optic sensors monitor road health real-time monitoring batch monitoring Engenharia e Tecnologia::Outras Engenharias e Tecnologias Indústria, inovação e infraestruturas |
title_short |
A Big Data system architecture to support the monitoring of paved roads |
title_full |
A Big Data system architecture to support the monitoring of paved roads |
title_fullStr |
A Big Data system architecture to support the monitoring of paved roads |
title_full_unstemmed |
A Big Data system architecture to support the monitoring of paved roads |
title_sort |
A Big Data system architecture to support the monitoring of paved roads |
author |
Oliveira e Sá, Jorge |
author_facet |
Oliveira e Sá, Jorge Rebelo, Francisco José Pereira Silva, Diogo Teles, Gabriel Ramos, Diogo Romeu, José |
author_role |
author |
author2 |
Rebelo, Francisco José Pereira Silva, Diogo Teles, Gabriel Ramos, Diogo Romeu, José |
author2_role |
author author author author author |
dc.contributor.none.fl_str_mv |
Universidade do Minho |
dc.contributor.author.fl_str_mv |
Oliveira e Sá, Jorge Rebelo, Francisco José Pereira Silva, Diogo Teles, Gabriel Ramos, Diogo Romeu, José |
dc.subject.por.fl_str_mv |
Big Data Big Data architecture fibre-optic sensors monitor road health real-time monitoring batch monitoring Engenharia e Tecnologia::Outras Engenharias e Tecnologias Indústria, inovação e infraestruturas |
topic |
Big Data Big Data architecture fibre-optic sensors monitor road health real-time monitoring batch monitoring Engenharia e Tecnologia::Outras Engenharias e Tecnologias Indústria, inovação e infraestruturas |
description |
Today, everything is connected, including the exchange of data and the generation of new information. As a result, large amounts of data are being collected at an ever-increasing rate and in a variety of forms, a phenomenon now known as Big Data. Recent developments in information and communication technologies are driving the generation of significant amounts of data from multiple sources, namely sensors. In response to these technological advances and data challenges, this paper proposes a Big Data system architecture for paved road monitoring and implements part of this architecture on a section of road in Portugal as a case study. The challenge in the case study architecture is to collect and process sensor data in real time, at a rate of 500 records per second, producing 15 GBytes of data per day, using a real-time data stream for real-time monitoring and a batch data stream for deeper analysis. This allows users to obtain instant updates on road conditions such as the number of vehicles, loads, weather, and pavement temperatures on the road. They can monitor what is happening on the road in real time, receive alerts, and even gain insight into historical data, such as analysing the condition of structures or identifying traffic patterns. |
publishDate |
2023 |
dc.date.none.fl_str_mv |
2023-11-24 2023-11-24T00:00:00Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
https://hdl.handle.net/1822/89137 |
url |
https://hdl.handle.net/1822/89137 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
Oliveira e Sá, J.; Rebelo, F.; Silva, D.; Teles, G.; Ramos, D.; Romeu, J. A Big Data System Architecture to Support the Monitoring of Paved Roads. Infrastructures 2023, 8, 167. https://doi.org/10.3390/infrastructures8120167 2412-3811 10.3390/infrastructures8120167 https://www.mdpi.com/2412-3811/8/12/167 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
MDPI |
publisher.none.fl_str_mv |
MDPI |
dc.source.none.fl_str_mv |
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799137767365541888 |