On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study

Detalhes bibliográficos
Autor(a) principal: Qureshi, Basit
Data de Publicação: 2019
Outros Autores: Koubâa, Anis
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
Texto Completo: http://hdl.handle.net/10400.22/12935
Resumo: Energy efficiency in a data center is a challenge and has garnered researchers interest. In this study, we addressed the energy efficiency issue of a small scale data center by utilizing Single Board Computer (SBC)-based clusters. A compact layout was designed to build two clusters using 20 nodes each. Extensive testing was carried out to analyze the performance of these clusters using popular performance benchmarks for task execution time, memory/storage utilization, network throughput and energy consumption. Further, we investigated the cost of operating SBC-based clusters by correlating energy utilization for the execution time of various benchmarks using workloads of different sizes. Results show that, although the low-cost benefit of a cluster built with ARM-based SBCs is desirable, these clusters yield low comparable performance and energy efficiency due to limited onboard capabilities. It is possible to tweak Hadoop configuration parameters for an ARM-based SBC cluster to efficiently utilize resources. We present a discussion on the effectiveness of the SBC-based clusters as a testbed for inexpensive and green cloud computing research.
id RCAP_b8ba42fab62b823ad40bdca533026b28
oai_identifier_str oai:recipp.ipp.pt:10400.22/12935
network_acronym_str RCAP
network_name_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository_id_str 7160
spelling On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case StudyGreen cloud computingARM32 single board computersHadoop MapReducePower consumptionPerformance evaluationEnergy efficiency in a data center is a challenge and has garnered researchers interest. In this study, we addressed the energy efficiency issue of a small scale data center by utilizing Single Board Computer (SBC)-based clusters. A compact layout was designed to build two clusters using 20 nodes each. Extensive testing was carried out to analyze the performance of these clusters using popular performance benchmarks for task execution time, memory/storage utilization, network throughput and energy consumption. Further, we investigated the cost of operating SBC-based clusters by correlating energy utilization for the execution time of various benchmarks using workloads of different sizes. Results show that, although the low-cost benefit of a cluster built with ARM-based SBCs is desirable, these clusters yield low comparable performance and energy efficiency due to limited onboard capabilities. It is possible to tweak Hadoop configuration parameters for an ARM-based SBC cluster to efficiently utilize resources. We present a discussion on the effectiveness of the SBC-based clusters as a testbed for inexpensive and green cloud computing research.MDPIRepositório Científico do Instituto Politécnico do PortoQureshi, BasitKoubâa, Anis2019-03-01T16:52:02Z20192019-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10400.22/12935eng10.3390/electronics8020182info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-03-13T12:54:54Zoai:recipp.ipp.pt:10400.22/12935Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T17:33:10.250964Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse
dc.title.none.fl_str_mv On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study
title On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study
spellingShingle On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study
Qureshi, Basit
Green cloud computing
ARM32 single board computers
Hadoop MapReduce
Power consumption
Performance evaluation
title_short On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study
title_full On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study
title_fullStr On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study
title_full_unstemmed On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study
title_sort On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study
author Qureshi, Basit
author_facet Qureshi, Basit
Koubâa, Anis
author_role author
author2 Koubâa, Anis
author2_role author
dc.contributor.none.fl_str_mv Repositório Científico do Instituto Politécnico do Porto
dc.contributor.author.fl_str_mv Qureshi, Basit
Koubâa, Anis
dc.subject.por.fl_str_mv Green cloud computing
ARM32 single board computers
Hadoop MapReduce
Power consumption
Performance evaluation
topic Green cloud computing
ARM32 single board computers
Hadoop MapReduce
Power consumption
Performance evaluation
description Energy efficiency in a data center is a challenge and has garnered researchers interest. In this study, we addressed the energy efficiency issue of a small scale data center by utilizing Single Board Computer (SBC)-based clusters. A compact layout was designed to build two clusters using 20 nodes each. Extensive testing was carried out to analyze the performance of these clusters using popular performance benchmarks for task execution time, memory/storage utilization, network throughput and energy consumption. Further, we investigated the cost of operating SBC-based clusters by correlating energy utilization for the execution time of various benchmarks using workloads of different sizes. Results show that, although the low-cost benefit of a cluster built with ARM-based SBCs is desirable, these clusters yield low comparable performance and energy efficiency due to limited onboard capabilities. It is possible to tweak Hadoop configuration parameters for an ARM-based SBC cluster to efficiently utilize resources. We present a discussion on the effectiveness of the SBC-based clusters as a testbed for inexpensive and green cloud computing research.
publishDate 2019
dc.date.none.fl_str_mv 2019-03-01T16:52:02Z
2019
2019-01-01T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://hdl.handle.net/10400.22/12935
url http://hdl.handle.net/10400.22/12935
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv 10.3390/electronics8020182
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv MDPI
publisher.none.fl_str_mv MDPI
dc.source.none.fl_str_mv reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron:RCAAP
instname_str Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
instacron_str RCAAP
institution RCAAP
reponame_str Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
collection Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)
repository.name.fl_str_mv Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação
repository.mail.fl_str_mv
_version_ 1799131423987204096