Big data benchmark suites must include a diversity of data and workloads to be useful in fairly evaluating big data systems and architectures. However, using truly comprehensive benchmarks poses great challenges for the architecture community. First, we need to thoroughly understand the behaviors of a variety of workloads. Second, our usual simulation-based research methods become prohibitively expensive for big data. As big data is an emerging field, more and more software stacks are being proposed to facilitate the development of big data applications, which aggravates hese challenges. In this paper, we first use Principle Component Analysis (PCA) to identify the most important characteristics from 45 metrics to characterize big data workloads from BigDataBench, a comprehensive big data benchmark suite. Second, we apply a clustering technique to the principle components obtained from the PCA to investigate the similarity among big data workloads, and we verify the importance of including different software stacks for big data benchmarking. Third, we select seven representative big data workloads by removing redundant ones and release the BigDataBench simulation version, which is publicly available from http://prof.ict.ac.cn/BigDataBench/simulatorversion/.
Characterizing Data Analysis Workloads in Data Centers
随着数据量的迅速爆炸,越来越多的公司正在使用数据中心来做出有效的决策并获得竞争优势。数据分析应用在数据中心中扮演重要角色,因此理解它们的行为以便进一步提高数据中心计算机系统的性能变得越来越重要。在本文中,在调查了三个最重要的应用领域的页面浏览量和每日访问量,我们选择了11个代表性的数据分析工作负载,并通过使用硬件性能计数器来表征其微体系结构特征,以了解数据分析工作负载的影响和意义上的系统配备了现代超标量无序处理器。我们对工作负载的研究表明,数据分析应用程序具有许多固有的特征,这些特征使它们与桌面(SPEC CPU 2006),HPC(HPCC)和服务工作负载(包括传统服务器工作负载(SPECweb2005)和横向扩展服务工作负载(CloudSuite中的六个基准中的四个))不同,因此我们给出了一些架构和系统优化建议。基于我们的工作负载特征化工作,我们发布了一个名为DCBench的基准测试套件,用于典型的数据中心工作负载,包括数据分析和服务工作负载,并在我们的项目主页http://prof.ict.ac.cn/DCBench上提供开源许可。我们希望DCBench能够为数据中心计算的架构和中小规模系统研究提供帮助。
How Does It Function? Characterizing Long-term Trends in Production Serverless Workloads
Huawei Edinburgh Research Centre(华为爱丁堡研究中心);Hangzhou Research Centre, Central Software Institute, Huawei(华为中央软件院杭州研究中心);University of St Andrews(圣安德鲁斯大学)