arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1307.8013cs.PF
收藏

描述数据中心中的数据分析工作负载

Characterizing Data Analysis Workloads in Data Centers

Zhen Jia, Lei Wang, Jianfeng Zhan, Lixin Zhang, Chunjie Luo

摘要:

随着数据量的迅速爆炸,越来越多的公司正在使用数据中心来做出有效的决策并获得竞争优势。数据分析应用在数据中心中扮演重要角色,因此理解它们的行为以便进一步提高数据中心计算机系统的性能变得越来越重要。在本文中,在调查了三个最重要的应用领域的页面浏览量和每日访问量,我们选择了11个代表性的数据分析工作负载,并通过使用硬件性能计数器来表征其微体系结构特征,以了解数据分析工作负载的影响和意义上的系统配备了现代超标量无序处理器。我们对工作负载的研究表明,数据分析应用程序具有许多固有的特征,这些特征使它们与桌面(SPEC CPU 2006),HPC(HPCC)和服务工作负载(包括传统服务器工作负载(SPECweb2005)和横向扩展服务工作负载(CloudSuite中的六个基准中的四个))不同,因此我们给出了一些架构和系统优化建议。基于我们的工作负载特征化工作,我们发布了一个名为DCBench的基准测试套件,用于典型的数据中心工作负载,包括数据分析和服务工作负载,并在我们的项目主页http://prof.ict.ac.cn/DCBench上提供开源许可。我们希望DCBench能够为数据中心计算的架构和中小规模系统研究提供帮助。

英文摘要:

As the amount of data explodes rapidly, more and more corporations are using data centers to make effective decisions and gain a competitive edge. Data analysis applications play a significant role in data centers, and hence it has became increasingly important to understand their behaviors in order to further improve the performance of data center computer systems. In this paper, after investigating three most important application domains in terms of page views and daily visitors, we choose eleven representative data analysis workloads and characterize their micro-architectural characteristics by using hardware performance counters, in order to understand the impacts and implications of data analysis workloads on the systems equipped with modern superscalar out-of-order processors. Our study on the workloads reveals that data analysis applications share many inherent characteristics, which place them in a different class from desktop (SPEC CPU2006), HPC (HPCC), and service workloads, including traditional server workloads (SPECweb2005) and scale-out service workloads (four among six benchmarks in CloudSuite), and accordingly we give several recommendations for architecture and system optimizations. On the basis of our workload characterization work, we released a benchmark suite named DCBench for typical datacenter workloads, including data analysis and service workloads, with an open-source license on our project home page on http://prof.ict.ac.cn/DCBench. We hope that DCBench is helpful for performing architecture and small-to-medium scale system researches for datacenter computing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑