BOPS,不是FLOPS!一种新的数据中心性能度量模型
BOPS, Not FLOPS! A New Metric and Roofline Performance Model For Datacenter Computing
摘要:
对于新兴的数据中心(简称DC)工作负载,例如在线互联网服务或离线数据分析,如何评估上限性能并提供苹果对苹果的比较是根本问题。为此,一个统一的以计算为中心的指标是一个基本要求。作为最重要的以计算为中心的性能指标,FLOPS多年来一直指导着计算系统的发展。然而,我们的观察表明,DC工作负载的平均FLOPS效率仅为0.1%,这意味着FLOPS不适合DC计算。为了解决上述问题,我们提出了BOPS(每秒基本操作),这是每秒完成的BOP(基本操作)的平均数量。分析了17种典型DC工作负载的特性,提取了由算术、比较和数组寻址的整数和浮点运算组成的最小代表运算操作集。然后,我们提出了形式化的BOPS定义和基于BOPS的上限性能模型。最后,还实现了BOPS测量工具。我们在三个典型的英特尔处理器平台上进行了17个DC工作负载的实验。首先,BOPS可以反映不同计算系统的性能差距,峰值BOPS性能差距与平均DC工作负载的挂钟时间差距之间的偏差不超过10%。其次,Sort工作负载在实验平台上可以达到32%的BOPS效率。最后,我们给出了两个BOPS的使用案例。一种是基于BOPS的系统评估,我们说明了BOPS可以比较来自多个域的工作负载的性能。另一种是基于BOPS的优化。我们表明,在基于BOPS的上限模型的指导下,Sort工作负载和Redis工作负载分别实现了4.4倍和1.2倍的性能提升。
英文摘要:
For emerging datacenter (in short, DC) workloads, such as online Internet services or offline data analytics, how to evaluate the upper bound performance and provide apple-to-apple comparisons are fundamental problems. To this end, a unified computation-centric metric is an essential requirement. As the most important computation-centric performance metric, FLOPS has guided computing systems evolutions for many years. However, our observations demonstrate that the average FLOPS efficiency of the DC workloads is only 0.1%, which implies that FLOPS is inappropriate for DC computing. To address the above issue, we propose BOPS (Basic Operations Per Second), which is the average number of BOPs (Basic OPerations) completed per second. We conduct the analysis on the characteristics of seventeen typical DC workloads and extract the minimum representative computation operations set, which is composed of integer and floating point computation operations of arithmetic, comparing and array addressing. Then, we propose the formalized BOPS definition and the BOPS based upper bound performance model. Finally, the BOPS measuring tool is also implemented. We perform experiments with seventeen DC workloads on three typical Intel processors platforms. First, BOPS can reflect the performance gap of different computing systems, the bias between the peak BOPS performance gap and the average DC workloads' wall clock time gap is no more than 10%. Second, the Sort workload can achieve 32% BOPS efficiency on the experimental platform. At last, we present two use cases of BOPS. One is the BOPS based system evaluation, we illustrate that BOPS can compare performance of workloads from multiple domains. The other is BOPS based optimizations. We show that under the guiding of the BOPS based upper bound model, the Sort workload and the Redis workload achieve 4.4X and 1.2X performance improvements respectively.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。