Serverless Application for price compasion

Detalhes bibliográficos
Autor(a) principal: Amaro, Tomás Filipe Vicente
Data de Publicação: 2023
Tipo de documento: Dissertação
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10362/150434
Resumo: Project Work presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced Analytics, specialization in Data Science
id RCAP_c94ca2194dd6fc77b5b612bf96a51c4d
oai_identifier_str oai:run.unl.pt:10362/150434
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Serverless Application for price compasionBig DataCloud ComputingPrice ComparisonServerlessWeb ScrapingProject Work presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced Analytics, specialization in Data ScienceThis project comes in collaboration with Deloitte to deliver a secure endpoint with access to a database where a catalog of retail products will be represented with their prices in each of the stores of various retailers. This database allows price comparisons between stores and retailers. The project's architecture was designed according to a serverless concept, prioritizing scalability and availability, discarding maintenance and server configurations concerns. To achieve the idealized architecture, the project was developed using AWS cloud services, where the functions of ingestion and data processing are allocated and all other components of the project. I will also take a closer look at each of the various technologies and libraries that were chosen for each part of the process, as well as their contribution to the functioning of the project. The result is a stable, secure, and fast structure, capable of providing information about retail products, with the possibility of scaling horizontally without limits, which offers little maintenance thanks to its serverless design. The database that feeds the API contains a catalog with more than 30,000 products for which we have more than two million daily prices from various retailers in various stores.Rodrigues, Jorge Manuel CarrolaRUNAmaro, Tomás Filipe Vicente2023-03-13T14:49:53Z2023-01-252023-01-25T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10362/150434TID:203228405enginfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2024-03-11T05:32:24Zoai:run.unl.pt:10362/150434Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-20T03:54:05.602285Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Serverless Application for price compasion
title Serverless Application for price compasion
spellingShingle Serverless Application for price compasion
Amaro, Tomás Filipe Vicente
Big Data
Cloud Computing
Price Comparison
Serverless
Web Scraping
title_short Serverless Application for price compasion
title_full Serverless Application for price compasion
title_fullStr Serverless Application for price compasion
title_full_unstemmed Serverless Application for price compasion
title_sort Serverless Application for price compasion
author Amaro, Tomás Filipe Vicente
author_facet Amaro, Tomás Filipe Vicente
author_role author
dc.contributor.none.fl_str_mv Rodrigues, Jorge Manuel Carrola
RUN
dc.contributor.author.fl_str_mv Amaro, Tomás Filipe Vicente
dc.subject.por.fl_str_mv Big Data
Cloud Computing
Price Comparison
Serverless
Web Scraping
topic Big Data
Cloud Computing
Price Comparison
Serverless
Web Scraping
description Project Work presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced Analytics, specialization in Data Science
publishDate 2023
dc.date.none.fl_str_mv 2023-03-13T14:49:53Z
2023-01-25
2023-01-25T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10362/150434
TID:203228405
url http://hdl.handle.net/10362/150434
identifier_str_mv TID:203228405
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799138130573393920

Registros relacionados