arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.06043cs.DB
收藏

云数据库上的自动配置调优:综述

Automatic Configuration Tuning on Cloud Database: A Survey

Limeng Zhang, M. Ali Babar

AI总结:

本文综述云数据库自动配置调优方法,系统比较贝叶斯优化、神经网络、强化学习和搜索类技术,并梳理调优流水线、实验设置、基准与未来方向。

摘要:

面对大数据的挑战,现代云数据库管理系统旨在高效地存储、组织和检索数据,为复杂的数据处理与分析支持最佳性能、可扩展性和可靠性。然而,在现代数据库中获得良好性能并非易事,因为这些系统因拥有数十个可配置旋钮而广为人知,例如硬件设置、软件设置、数据库物理与逻辑设计等;这些旋钮控制运行时行为并影响数据库性能。为找到实现最佳性能的最优配置,研究者已围绕 DBMS 中的自动参数调优开展了大量研究。本文全面综述了主流配置调优技术,包括基于 Bayesian optimization 的解决方案、基于 Neural network 的解决方案、基于 Reinforcement learning 的解决方案以及基于 Search 的解决方案。此外,本文考察了参数调优流水线的基础方面,包括调优目标、工作负载表征、特征剪枝、经验知识、配置推荐和实验设置。我们重点说明了各组成部分中的技术比较及其对应解决方案,并介绍了用于性能评估的实验设置。最后,本文进行总结并提出未来研究机会。本文旨在通过提供现有最先进解决方案、研究方向和评估基准,帮助未来研究者和实践者更好地理解云数据库中的自动参数调优。

英文摘要:

Faced with the challenges of big data, modern cloud database management systems are designed to efficiently store, organize, and retrieve data, supporting optimal performance, scalability, and reliability for complex data processing and analysis. However, achieving good performance in modern databases is non-trivial as they are notorious for having dozens of configurable knobs, such as hardware setup, software setup, database physical and logical design, etc., that control runtime behaviors and impact database performance. To find the optimal configuration for achieving optimal performance, extensive research has been conducted on automatic parameter tuning in DBMS. This paper provides a comprehensive survey of predominant configuration tuning techniques, including Bayesian optimization-based solutions, Neural network-based solutions, Reinforcement learning-based solutions, and Search-based solutions. Moreover, it investigates the fundamental aspects of parameter tuning pipeline, including tuning objective, workload characterization, feature pruning, knowledge from experience, configuration recommendation, and experimental settings. We highlight technique comparisons in each component, corresponding solutions, and introduce the experimental setting for performance evaluation. Finally, we conclude this paper and present future research opportunities. This paper aims to assist future researchers and practitioners in gaining a better understanding of automatic parameter tuning in cloud databases by providing state-of-the-art existing solutions, research directions, and evaluation benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑