使用细粒度高频虚拟快照加速MVCC中的分析处理
Accelerating Analytical Processing in MVCC using Fine-Granular High-Frequency Virtual Snapshotting
摘要:
有效的事务管理是一项微妙的任务。由于系统面临着本质上不同类型的事务,从点更新到长时间运行的分析计算,很难用单个处理组件来满足它们的个性化需求。不幸的是,现在大多数系统都依赖于这样一个单一的组件,该组件使用多版本并发控制(MVCC)来实现其并行性。虽然MVCC可以很好地并行化短时间运行的OLTP事务,但它在包含长时间运行的以扫描为中心的OLAP查询的混合工作负载的情况下会遇到困难,因为扫描必须通过大量的版本化数据来工作。为了克服这个问题,我们提出了一个系统,它重新引入了异构事务处理的概念:OLAP事务外包运行在单独的(虚拟)快照,而OLTP事务运行在最近的数据库表示。在这两个组件中,MVCC确保了高度的并发性。这种异构方法的最大挑战是以高频率生成快照。以前的方法深受快照创建的巨大成本的影响。在我们的系统中,我们通过引入定制的系统调用vm_snapshot克服了操作系统的限制,该调用是根据我们的精确需求手工定制的:它允许以非常高的频率创建细粒度快照,使快照创建阶段的数量级比最先进的方法快。基于TPC-H事务和手工OLTP事务的异构工作负载的实验评估表明,我们的系统在混合工作负载上的分析事务吞吐量比同构方法高得多。从这个意义上说,我们引入了一个通过引入自定义内核功能来加速分析处理的系统:AnKerDB。
英文摘要:
Efficient transactional management is a delicate task. As systems face transactions of inherently different types, ranging from point updates to long running analytical computations, it is hard to satisfy their individual requirements with a single processing component. Unfortunately, most systems nowadays rely on such a single component that implements its parallelism using multi-version concurrency control (MVCC). While MVCC parallelizes short-running OLTP transactions very well, it struggles in the presence of mixed workloads containing long-running scan-centric OLAP queries, as scans have to work their way through large amounts of versioned data. To overcome this problem, we propose a system, which reintroduces the concept of heterogeneous transaction processing: OLAP transactions are outsourced to run on separate (virtual) snapshots while OLTP transactions run on the most recent representation of the database. Inside both components, MVCC ensures a high degree of concurrency. The biggest challenge of such a heterogeneous approach is to generate the snapshots at a high frequency. Previous approaches heavily suffered from the tremendous cost of snapshot creation. In our system, we overcome the restrictions of the OS by introducing a custom system call vm_snapshot, that is hand-tailored to our precise needs: it allows fine-granular snapshot creation at very high frequencies, rendering the snapshot creation phase orders of magnitudes faster than state-of-the-art approaches. Our experimental evaluation on a heterogeneous workload based on TPC-H transactions and handcrafted OLTP transactions shows that our system enables significantly higher analytical transaction throughputs on mixed workloads than homogeneous approaches. In this sense, we introduce a system that accelerates Analytical processing by introducing custom Kernel functionalities: AnKerDB.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。