arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1207.0894cs.DC
收藏

云计算中异构Hadoop集群的性能问题

Performance Issues of Heterogeneous Hadoop Clusters in Cloud Computing

B. Thirumala Rao, N. V. Sridevi, V. Krishna Reddy, L. S. S. Reddy

摘要:

如今,大多数云应用程序处理大量数据以提供所需的结果。云应用程序要处理的数据量的增长速度远远超过计算能力。这种增长需要处理和分析信息的新策略。处理大量数据需要两件事:1)廉价、可靠的存储2)用于分析非结构化和结构化数据的新工具。Hadoop是一个强大的开源软件平台,可以解决这两个问题。当前的Hadoop实现假设集群中的计算节点本质上是同构的。Hadoop在异构集群中缺乏性能,其中节点具有不同的计算能力。在本文中,我们讨论了影响hadoop在异构集群中的性能的问题,并提供了一些如何克服这些瓶颈的指导方针

英文摘要:

Nowadays most of the cloud applications process large amount of data to provide the desired results. Data volumes to be processed by cloud applications are growing much faster than computing power. This growth demands new strategies for processing and analyzing information. Dealing with large data volumes requires two things: 1) Inexpensive, reliable storage 2) New tools for analyzing unstructured and structured data. Hadoop is a powerful open source software platform that addresses both of these problems. The current Hadoop implementation assumes that computing nodes in a cluster are homogeneous in nature. Hadoop lacks performance in heterogeneous clusters where the nodes have different computing capacity. In this paper we address the issues that affect the performance of hadoop in heterogeneous clusters and also provided some guidelines on how to overcome these bottlenecks

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑