arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.11080cs.DB
收藏

Greenplum:用于事务处理和分析工作负载的混合数据库

Greenplum: A Hybrid Database for Transactional and Analytical Workloads

Zhenghua Lyu, Huan Hubert Zhang, Gang Xiong, Haozhou Wang, Gang Guo, Jinbao Chen, Asim Praveen, Yu Yang, Xiaoming Gao, Ashwin Agrawal, Alexandra Wang, Wen Lin, … 展开作者

Zhenghua Lyu, Huan Hubert Zhang, Gang Xiong, Haozhou Wang, Gang Guo, Jinbao Chen, Asim Praveen, Yu Yang, Xiaoming Gao, Ashwin Agrawal, Alexandra Wang, Wen Lin, Junfeng Yang, Hao Wu, Xiaoliang Li, Feng Guo, Jiang Wu, Jesse Zhang, Venkatesh Raghavan

摘要:

企业数据仓库解决方案支持实时在线事务处理(OLTP)查询以及长时间运行的在线分析处理(OLAP)工作负载的需求正在增长。Greenplum数据库传统上被称为OLAP数据仓库系统,处理OLTP工作负载的能力有限。在本文中,我们将Greenplum扩展为一个混合系统,以同时为OLTP和OLAP工作负载提供服务。我们在这里所面临的挑战是在保持ACID属性的同时以最小的性能开销实现这一目标。在这项工作中,我们确定了工程和性能瓶颈,如表现不佳的限制性锁定和两阶段提交协议。接下来,我们解决事务查询和分析查询之间的资源争用问题。我们提出了一个全局死锁检测器,以增加查询处理的并发性。当保证更新数据的事务只驻留在一个段上时,我们引入了单阶段提交来加速查询处理。我们的资源组模型引入了将OLAP和OLTP工作负载分离到更合适的查询处理模式的功能。TPC-B和CH-benCHmark基准测试表明,我们的方法在不牺牲OLAP性能的情况下提高OLTP性能的有效性。

英文摘要:

Demand for enterprise data warehouse solutions to support real-time Online Transaction Processing (OLTP) queries as well as long-running Online Analytical Processing (OLAP) workloads is growing. Greenplum database is traditionally known as an OLAP data warehouse system with limited ability to process OLTP workloads. In this paper, we augment Greenplum into a hybrid system to serve both OLTP and OLAP workloads. The challenge we address here is to achieve this goal while maintaining the ACID properties with minimal performance overhead. In this effort, we identify the engineering and performance bottlenecks such as the under-performing restrictive locking and the two-phase commit protocol. Next we solve the resource contention issues between transactional and analytical queries. We propose a global deadlock detector to increase the concurrency of query processing. When transactions that update data are guaranteed to reside on exactly one segment we introduce one-phase commit to speed up query processing. Our resource group model introduces the capability to separate OLAP and OLTP workloads into more suitable query processing mode. Our experimental evaluation on the TPC-B and CH-benCHmark benchmarks demonstrates the effectiveness of our approach in boosting the OLTP performance without sacrificing the OLAP performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑