Duet基准测试:提高云中的测量精度
Duet Benchmarking: Improving Measurement Accuracy in the Cloud
摘要:
我们调查的二重奏测量程序,这有助于提高性能比较实验的准确性,通过并行执行测量的工件,并评估其相对性能在一起,而不是单独的共享机器上进行。具体来说,我们分析了在多个云环境中的程序的行为,并使用实验证据来回答多个研究问题的假设基础的程序。我们展示了测试的ScalaBench(和DaCapo)工作负载的准确度提高了2.3倍到12.5倍(平均5.03倍),SPEC CPU 2017工作负载的准确度提高了23.8倍到82.4倍(平均37.4倍)。
英文摘要:
We investigate the duet measurement procedure, which helps improve the accuracy of performance comparison experiments conducted on shared machines by executing the measured artifacts in parallel and evaluating their relative performance together, rather than individually. Specifically, we analyze the behavior of the procedure in multiple cloud environments and use experimental evidence to answer multiple research questions concerning the assumption underlying the procedure. We demonstrate improvements in accuracy ranging from 2.3x to 12.5x (5.03x on average) for the tested ScalaBench (and DaCapo) workloads, and from 23.8x to 82.4x (37.4x on average) for the SPEC CPU 2017 workloads.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。