基于SBC集群的能效和性能评估:Hadoop案例研究
On Energy Efficiency and Performance Evaluation of SBC based Clusters: A Hadoop case study
摘要:
数据中心的能源效率是一个挑战,并引起了研究人员的兴趣。在本文中,我们解决了能源效率的问题,一个小规模的数据中心,利用单板的计算机(SBC)的集群。一个紧凑的设计布局,建立两个集群使用20个节点。进行了广泛的测试,以分析这些集群的性能,使用流行的性能基准的任务执行时间,内存/存储利用率,网络吞吐量和能耗。此外,我们调查的成本SBC集群的运行相关的能源利用率的执行时间的各种基准使用不同大小的工作负载。结果表明,虽然与基于ARM的SBC构建的集群的低成本效益是可取的,这些集群产生低可比的性能和能源效率,由于有限的板载能力。可以调整基于ARM的SBC集群的Hadoop配置参数以有效利用资源。我们提出,讨论的有效性的SBC为基础的集群作为一个测试平台,廉价和绿色的云计算研究。
英文摘要:
Energy efficiency in a data center is a challenge and has garnered researchers interest. In this paper we address the energy efficiency issue of a small scale data center by utilizing Single Board Computer (SBC) based clusters. A compact design layout is presented to build two clusters using 20 nodes each. Extensive testing was carried out to analyze the performance of these clusters using popular performance benchmarks for task execution time, memory/storage utilization, network throughput and energy consumption. Further, we investigate the cost of operating SBC based clusters by correlating energy utilization for the execution time of various benchmarks using workloads of different sizes. Results show that, although the low-cost benefit of a cluster built with ARM-based SBCs is desirable, these clusters yield low comparable performance and energy efficiency due to limited onboard capabilities. It is possible to tweak Hadoop configuration parameters for an ARM-based SBC cluster to efficiently utilize resources. We present, a discussion on the effectiveness of the SBC-based clusters as a testbed for inexpensive and green cloud computing research.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。