随着数据量的迅速爆炸,越来越多的公司正在使用数据中心来做出有效的决策并获得竞争优势。数据分析应用在数据中心中扮演重要角色,因此理解它们的行为以便进一步提高数据中心计算机系统的性能变得越来越重要。在本文中,在调查了三个最重要的应用领域的页面浏览量和每日访问量,我们选择了11个代表性的数据分析工作负载,并通过使用硬件性能计数器来表征其微体系结构特征,以了解数据分析工作负载的影响和意义上的系统配备了现代超标量无序处理器。我们对工作负载的研究表明,数据分析应用程序具有许多固有的特征,这些特征使它们与桌面(SPEC CPU 2006),HPC(HPCC)和服务工作负载(包括传统服务器工作负载(SPECweb2005)和横向扩展服务工作负载(CloudSuite中的六个基准中的四个))不同,因此我们给出了一些架构和系统优化建议。基于我们的工作负载特征化工作,我们发布了一个名为DCBench的基准测试套件,用于典型的数据中心工作负载,包括数据分析和服务工作负载,并在我们的项目主页http://prof.ict.ac.cn/DCBench上提供开源许可。我们希望DCBench能够为数据中心计算的架构和中小规模系统研究提供帮助。
英文摘要:
As the amount of data explodes rapidly, more and more corporations are using data centers to make effective decisions and gain a competitive edge. Data analysis applications play a significant role in data centers, and hence it has became increasingly important to understand their behaviors in order to further improve the performance of data center computer systems. In this paper, after investigating three most important application domains in terms of page views and daily visitors, we choose eleven representative data analysis workloads and characterize their micro-architectural characteristics by using hardware performance counters, in order to understand the impacts and implications of data analysis workloads on the systems equipped with modern superscalar out-of-order processors. Our study on the workloads reveals that data analysis applications share many inherent characteristics, which place them in a different class from desktop (SPEC CPU2006), HPC (HPCC), and service workloads, including traditional server workloads (SPECweb2005) and scale-out service workloads (four among six benchmarks in CloudSuite), and accordingly we give several recommendations for architecture and system optimizations. On the basis of our workload characterization work, we released a benchmark suite named DCBench for typical datacenter workloads, including data analysis and service workloads, with an open-source license on our project home page on http://prof.ict.ac.cn/DCBench. We hope that DCBench is helpful for performing architecture and small-to-medium scale system researches for datacenter computing.
Simple and Effective Dynamic Provisioning for Power-Proportional Data Centers
能源消耗是数据中心运营的重要成本。然而,当工作负载较低时,很大一部分能量用于为空闲的服务器供电。动态供应技术旨在通过关闭不必要的服务器来节省这部分能量。在本文中,我们探讨了了解未来的工作负载信息可以为动态配置带来多大的性能增益。特别是,我们研究的成本模型下,一个正在运行的服务器消耗固定量的能源每单位时间的动态配置问题,并开发在线解决方案,并没有未来的工作负载信息。我们首先揭示了一个优雅的离线动态供应问题的结构,这使我们能够表征和实现的最佳解决方案,在{}“分而治之”的方式。然后,我们利用这一洞察力,设计三个在线算法的竞争力比$2-α$,$(e-α)/(e-1)\approx1.58-α/(e-1)$和$e/(e-1+α)$,分别,其中$0\leqα\leq1$是一个关键窗口中,未来的工作量信息是可用的分数。一个基本的观察结果是,\emph{future workload information beyond the critical window will not} \emph{improve dynamic provisioning performance}。我们的算法是分散的,并且易于实现。我们证明了他们的有效性,在模拟使用现实世界的痕迹。我们还将其性能与最先进的解决方案进行了比较。
How Does It Function? Characterizing Long-term Trends in Production Serverless Workloads
Huawei Edinburgh Research Centre(华为爱丁堡研究中心);Hangzhou Research Centre, Central Software Institute, Huawei(华为中央软件院杭州研究中心);University of St Andrews(圣安德鲁斯大学)