arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1912.09256cs.PFcs.DC
收藏

大数据性能在现代云网络中可再现吗?

Is Big Data Performance Reproducible in Modern Cloud Networks?

Alexandru Uta, Alexandru Custura, Dmitry Duplyakin, Ivo Jimenez, Jan Rellermeyer, Carlos Maltzahn, Robert Ricci, Alexandru Iosup

摘要:

十多年来,云计算从业者和性能工程师一直认为性能可变性是一个问题。然而,我们对顶级系统会议的调查显示,研究社区在云中运行实验时经常忽略可变性。以网络为重点,我们通过从主流商业云和私有研究云收集跟踪信息,评估可变性对基于云的大数据工作负载的影响。我们的数据汇集由数百万个数据点组成,同时传输超过9 PB的数据。我们描述了我们的数据中存在的网络可变性,并表明,即使商业云提供商实施服务质量执行机制,可变性仍然会发生,甚至加剧了这种机制和服务提供商的政策。我们展示了大数据工作负载如何受到显着放缓的影响,并且缺乏可预测性和可复制性,即使使用最先进的实验技术。我们为从业者提供指导,以减少大数据性能的波动性,使实验更具可重复性。

英文摘要:

Performance variability has been acknowledged as a problem for over a decade by cloud practitioners and performance engineers. Yet, our survey of top systems conferences reveals that the research community regularly disregards variability when running experiments in the cloud. Focusing on networks, we assess the impact of variability on cloud-based big-data workloads by gathering traces from mainstream commercial clouds and private research clouds. Our data collection consists of millions of datapoints gathered while transferring over 9 petabytes of data. We characterize the network variability present in our data and show that, even though commercial cloud providers implement mechanisms for quality-of-service enforcement, variability still occurs, and is even exacerbated by such mechanisms and service provider policies. We show how big-data workloads suffer from significant slowdowns and lack predictability and replicability, even when state-of-the-art experimentation techniques are used. We provide guidelines for practitioners to reduce the volatility of big data performance, making experiments more repeatable.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑