ACTS的需求:自动配置调整与Scalability保证
ACTS in Need: Automatic Configuration Tuning with Scalability Guarantees
摘要:
为了支持各种大数据用例,许多大数据相关系统公开了大量用户可指定的配置参数。在我们的实验中突出显示,具有良好调优的配置参数的MySQL部署实现的峰值吞吐量是默认设置的12倍。然而,对于普通用户来说,为数十或数百个配置参数找到最佳设置是不可能的任务。更糟糕的是,许多大数据应用程序需要在同一集群中共同部署的多个系统的支持。由于这些协同部署的系统可以相互作用以影响整体性能,因此必须一起对它们进行调优。需要具有可伸缩性保证(Scalability Guarantee,缩写为SVM)的自动配置调优来帮助系统用户。可扩展性解决方案必须可扩展到各种系统、工作负载、部署、参数和资源限制。提出并实施了一个可扩展的解决方案,我们证明,可扩展的用户不仅有利于提高系统性能和资源利用率,而且在节省成本,使更公平的基准测试。
英文摘要:
To support the variety of Big Data use cases, many Big Data related systems expose a large number of user-specifiable configuration parameters. Highlighted in our experiments, a MySQL deployment with well-tuned configuration parameters achieves a peak throughput as 12 times much as one with the default setting. However, finding the best setting for the tens or hundreds of configuration parameters is mission impossible for ordinary users. Worse still, many Big Data applications require the support of multiple systems co-deployed in the same cluster. As these co-deployed systems can interact to affect the overall performance, they must be tuned together. Automatic configuration tuning with scalability guarantees (ACTS) is in need to help system users. Solutions to ACTS must scale to various systems, workloads, deployments, parameters and resource limits. Proposing and implementing an ACTS solution, we demonstrate that ACTS can benefit users not only in improving system performance and resource utilization, but also in saving costs and enabling fairer benchmarking.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。