Big Data: state-of-the-art concepts, techniques, technologies, modeling approaches and research challenges

Detalhes bibliográficos
Autor(a) principal: Costa, Carlos
Data de Publicação: 2017
Outros Autores: Santos, Maribel Yasmina
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/1822/46855
Resumo: Current advancements in Information Technologies (IT) lead organizations to pursue high business value and competitive advantages through the collection, storage, processing and analysis of huge amounts of heterogonous data, generated at ever increasing rates. Data- driven organizations are often seen as environments wherein the analysis and understanding of products, people and transactions are of major relevance. Big Data, mainly defined as data with high volume, variety and velocity, creating severe limitations in traditional technologies, promises to leverage smarter insights based on challenging and more granular data sources, increasingly demanding emergent skills from data scientists to revolutionize business products, processes and services. The concept gained significant notoriety during the last years, since many business areas can benefit from this phenomenon, such as healthcare, public sector, retail, manufacturing and modern cities. Big Data as a research topic faces innumerous challenges, from the ambiguity and lack of common approaches to the need of significant organizational changes. Therefore, research on Big Data is relevant to assure that organizations have rigorously justified proofs that emergent techniques and technologies can help them making progress in data-driven business contexts. This work presents a state-of-the-art literature review in Big Data, including its current relevance, definition, techniques and technologies, while highlighting several research challenges in this field. Furthermore, this work also provides relevant rules for modelling databases in Big Data environments, which can be used to convert relational data models into column-oriented data models.
id RCAP_bf56fc6c6b5e427a5251c3f5b72d0401
oai_identifier_str oai:repositorium.sdum.uminho.pt:1822/46855
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling Big Data: state-of-the-art concepts, techniques, technologies, modeling approaches and research challengesBig DataNoSQLHadoopChallengesModellingReviewState-of-the-artTechniquesTechnologiesEngenharia e Tecnologia::Outras Engenharias e TecnologiasCurrent advancements in Information Technologies (IT) lead organizations to pursue high business value and competitive advantages through the collection, storage, processing and analysis of huge amounts of heterogonous data, generated at ever increasing rates. Data- driven organizations are often seen as environments wherein the analysis and understanding of products, people and transactions are of major relevance. Big Data, mainly defined as data with high volume, variety and velocity, creating severe limitations in traditional technologies, promises to leverage smarter insights based on challenging and more granular data sources, increasingly demanding emergent skills from data scientists to revolutionize business products, processes and services. The concept gained significant notoriety during the last years, since many business areas can benefit from this phenomenon, such as healthcare, public sector, retail, manufacturing and modern cities. Big Data as a research topic faces innumerous challenges, from the ambiguity and lack of common approaches to the need of significant organizational changes. Therefore, research on Big Data is relevant to assure that organizations have rigorously justified proofs that emergent techniques and technologies can help them making progress in data-driven business contexts. This work presents a state-of-the-art literature review in Big Data, including its current relevance, definition, techniques and technologies, while highlighting several research challenges in this field. Furthermore, this work also provides relevant rules for modelling databases in Big Data environments, which can be used to convert relational data models into column-oriented data models.This work has been supported by COMPETE: POCI-01-0145- FEDER-007043 and FCT – Fundação para a Ciência e Tecnologia within the Project Scope: UID/CEC/00319/2013, and the SusCity project, MITP-TB/CS/0026/2013.info:eu-repo/semantics/publishedVersionNewswoodUniversidade do MinhoCosta, CarlosSantos, Maribel Yasmina20172017-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/1822/46855engCosta, Carlos and Maribel Yasmina Santos, “Big Data: State-of-the-art Concepts, Techniques, Technologies, Modeling Approaches and Research Challenges”, IAENG International Journal of Computer Science, vol. 44, no. 3, pp285-301, 2017, ISSN: 1819656X1819-656Xinfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-07-21T12:04:28Zoai:repositorium.sdum.uminho.pt:1822/46855Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T18:54:47.378442Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv Big Data: state-of-the-art concepts, techniques, technologies, modeling approaches and research challenges
title Big Data: state-of-the-art concepts, techniques, technologies, modeling approaches and research challenges
spellingShingle Big Data: state-of-the-art concepts, techniques, technologies, modeling approaches and research challenges
Costa, Carlos
Big Data
NoSQL
Hadoop
Challenges
Modelling
Review
State-of-the-art
Techniques
Technologies
Engenharia e Tecnologia::Outras Engenharias e Tecnologias
title_short Big Data: state-of-the-art concepts, techniques, technologies, modeling approaches and research challenges
title_full Big Data: state-of-the-art concepts, techniques, technologies, modeling approaches and research challenges
title_fullStr Big Data: state-of-the-art concepts, techniques, technologies, modeling approaches and research challenges
title_full_unstemmed Big Data: state-of-the-art concepts, techniques, technologies, modeling approaches and research challenges
title_sort Big Data: state-of-the-art concepts, techniques, technologies, modeling approaches and research challenges
author Costa, Carlos
author_facet Costa, Carlos
Santos, Maribel Yasmina
author_role author
author2 Santos, Maribel Yasmina
author2_role author
dc.contributor.none.fl_str_mv Universidade do Minho
dc.contributor.author.fl_str_mv Costa, Carlos
Santos, Maribel Yasmina
dc.subject.por.fl_str_mv Big Data
NoSQL
Hadoop
Challenges
Modelling
Review
State-of-the-art
Techniques
Technologies
Engenharia e Tecnologia::Outras Engenharias e Tecnologias
topic Big Data
NoSQL
Hadoop
Challenges
Modelling
Review
State-of-the-art
Techniques
Technologies
Engenharia e Tecnologia::Outras Engenharias e Tecnologias
description Current advancements in Information Technologies (IT) lead organizations to pursue high business value and competitive advantages through the collection, storage, processing and analysis of huge amounts of heterogonous data, generated at ever increasing rates. Data- driven organizations are often seen as environments wherein the analysis and understanding of products, people and transactions are of major relevance. Big Data, mainly defined as data with high volume, variety and velocity, creating severe limitations in traditional technologies, promises to leverage smarter insights based on challenging and more granular data sources, increasingly demanding emergent skills from data scientists to revolutionize business products, processes and services. The concept gained significant notoriety during the last years, since many business areas can benefit from this phenomenon, such as healthcare, public sector, retail, manufacturing and modern cities. Big Data as a research topic faces innumerous challenges, from the ambiguity and lack of common approaches to the need of significant organizational changes. Therefore, research on Big Data is relevant to assure that organizations have rigorously justified proofs that emergent techniques and technologies can help them making progress in data-driven business contexts. This work presents a state-of-the-art literature review in Big Data, including its current relevance, definition, techniques and technologies, while highlighting several research challenges in this field. Furthermore, this work also provides relevant rules for modelling databases in Big Data environments, which can be used to convert relational data models into column-oriented data models.
publishDate 2017
dc.date.none.fl_str_mv 2017
2017-01-01T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/1822/46855
url http://hdl.handle.net/1822/46855
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Costa, Carlos and Maribel Yasmina Santos, “Big Data: State-of-the-art Concepts, Techniques, Technologies, Modeling Approaches and Research Challenges”, IAENG International Journal of Computer Science, vol. 44, no. 3, pp285-301, 2017, ISSN: 1819656X
1819-656X
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Newswood
publisher.none.fl_str_mv Newswood
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799132330797826048