On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study
Autor(a) principal: | |
---|---|
Data de Publicação: | 2019 |
Outros Autores: | |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | http://hdl.handle.net/10400.22/12935 |
Resumo: | Energy efficiency in a data center is a challenge and has garnered researchers interest. In this study, we addressed the energy efficiency issue of a small scale data center by utilizing Single Board Computer (SBC)-based clusters. A compact layout was designed to build two clusters using 20 nodes each. Extensive testing was carried out to analyze the performance of these clusters using popular performance benchmarks for task execution time, memory/storage utilization, network throughput and energy consumption. Further, we investigated the cost of operating SBC-based clusters by correlating energy utilization for the execution time of various benchmarks using workloads of different sizes. Results show that, although the low-cost benefit of a cluster built with ARM-based SBCs is desirable, these clusters yield low comparable performance and energy efficiency due to limited onboard capabilities. It is possible to tweak Hadoop configuration parameters for an ARM-based SBC cluster to efficiently utilize resources. We present a discussion on the effectiveness of the SBC-based clusters as a testbed for inexpensive and green cloud computing research. |
id |
RCAP_b8ba42fab62b823ad40bdca533026b28 |
---|---|
oai_identifier_str |
oai:recipp.ipp.pt:10400.22/12935 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case StudyGreen cloud computingARM32 single board computersHadoop MapReducePower consumptionPerformance evaluationEnergy efficiency in a data center is a challenge and has garnered researchers interest. In this study, we addressed the energy efficiency issue of a small scale data center by utilizing Single Board Computer (SBC)-based clusters. A compact layout was designed to build two clusters using 20 nodes each. Extensive testing was carried out to analyze the performance of these clusters using popular performance benchmarks for task execution time, memory/storage utilization, network throughput and energy consumption. Further, we investigated the cost of operating SBC-based clusters by correlating energy utilization for the execution time of various benchmarks using workloads of different sizes. Results show that, although the low-cost benefit of a cluster built with ARM-based SBCs is desirable, these clusters yield low comparable performance and energy efficiency due to limited onboard capabilities. It is possible to tweak Hadoop configuration parameters for an ARM-based SBC cluster to efficiently utilize resources. We present a discussion on the effectiveness of the SBC-based clusters as a testbed for inexpensive and green cloud computing research.MDPIRepositório Científico do Instituto Politécnico do PortoQureshi, BasitKoubâa, Anis2019-03-01T16:52:02Z20192019-01-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10400.22/12935eng10.3390/electronics8020182info:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-03-13T12:54:54Zoai:recipp.ipp.pt:10400.22/12935Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T17:33:10.250964Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study |
title |
On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study |
spellingShingle |
On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study Qureshi, Basit Green cloud computing ARM32 single board computers Hadoop MapReduce Power consumption Performance evaluation |
title_short |
On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study |
title_full |
On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study |
title_fullStr |
On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study |
title_full_unstemmed |
On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study |
title_sort |
On Energy Efficiency and Performance Evaluation of Single Board Computer Based Clusters: A Hadoop Case Study |
author |
Qureshi, Basit |
author_facet |
Qureshi, Basit Koubâa, Anis |
author_role |
author |
author2 |
Koubâa, Anis |
author2_role |
author |
dc.contributor.none.fl_str_mv |
Repositório Científico do Instituto Politécnico do Porto |
dc.contributor.author.fl_str_mv |
Qureshi, Basit Koubâa, Anis |
dc.subject.por.fl_str_mv |
Green cloud computing ARM32 single board computers Hadoop MapReduce Power consumption Performance evaluation |
topic |
Green cloud computing ARM32 single board computers Hadoop MapReduce Power consumption Performance evaluation |
description |
Energy efficiency in a data center is a challenge and has garnered researchers interest. In this study, we addressed the energy efficiency issue of a small scale data center by utilizing Single Board Computer (SBC)-based clusters. A compact layout was designed to build two clusters using 20 nodes each. Extensive testing was carried out to analyze the performance of these clusters using popular performance benchmarks for task execution time, memory/storage utilization, network throughput and energy consumption. Further, we investigated the cost of operating SBC-based clusters by correlating energy utilization for the execution time of various benchmarks using workloads of different sizes. Results show that, although the low-cost benefit of a cluster built with ARM-based SBCs is desirable, these clusters yield low comparable performance and energy efficiency due to limited onboard capabilities. It is possible to tweak Hadoop configuration parameters for an ARM-based SBC cluster to efficiently utilize resources. We present a discussion on the effectiveness of the SBC-based clusters as a testbed for inexpensive and green cloud computing research. |
publishDate |
2019 |
dc.date.none.fl_str_mv |
2019-03-01T16:52:02Z 2019 2019-01-01T00:00:00Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://hdl.handle.net/10400.22/12935 |
url |
http://hdl.handle.net/10400.22/12935 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
10.3390/electronics8020182 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.publisher.none.fl_str_mv |
MDPI |
publisher.none.fl_str_mv |
MDPI |
dc.source.none.fl_str_mv |
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799131423987204096 |