arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2307.08018cs.DB
收藏

通过协调复用与工作共享实现实时分析

Real-Time Analytics by Coordinating Reuse and Work Sharing

Panagiotis Sioulas, Ioannis Mytilinis, Anastasia Ailamaki

AI总结:

针对高并发参数化分析负载的实时响应难题,提出 ParCuR 框架,从访问方法、物化策略、两阶段优化和部分复用聚类四方面协调复用与工作共享,在 SSB、TPC-H 上分别取得 6.4 倍和 2 倍性能提升。

摘要:

分析工具通常需要对高并发参数化工作负载作出实时响应。一种常见解决方案是使用物化子表达式来回答查询,从而减少运行时处理。然而,由于查询仍被单独处理,并发的未完成计算会不断累积并增加响应时间。相比之下,共享执行通过利用查询之间重叠的工作来缓解并发影响并提高可扩展性,但它使用重量级共享算子,导致较高响应时间。因此,就其自身而言,复用和工作共享都无法为大批量查询提供实时响应。此外,朴素地结合这两种方法是无效的,并且由于过滤成本增加、边际收益降低以及可复用性下降,性能可能恶化。在本文中,我们提出 ParCuR,这是一个协调复用与工作共享的框架。ParCuR 在四个方面使复用适应工作共享:i)为降低过滤成本,它在物化结果上构建访问方法;ii)为解决工作共享收益与物化收益之间的冲突,它引入一种共享感知的物化策略;iii)为将复用纳入共享感知优化,它引入两阶段优化策略;iv)为提高可复用性并避免查询被部分覆盖时(尤其是在工作负载转移期间)出现性能陡降,它将部分复用与基于历史批次的数据聚类相结合。在 SSB 和 TPC-H 基准测试中,ParCuR 的性能分别比最先进的工作共享数据库高出 6.4 倍和 2 倍。

英文摘要:

Analytical tools often require real-time responses for highly concurrent parameterized workloads. A common solution is to answer queries using materialized subexpressions, hence reducing processing at runtime. However, as queries are still processed individually, concurrent outstanding computations accumulate and increase response times. By contrast, shared execution mitigates the effect of concurrency and improves scalability by exploiting overlapping work between queries but does so using heavyweight shared operators that result in high response times. Thus, on their own, both reuse and work sharing fail to provide real-time responses for large batches. Furthermore, naively combining the two approaches is ineffective and can deteriorate performance due to increased filtering costs, reduced marginal benefits, and lower reusability. In this work, we present ParCuR, a framework that harmonizes reuse with work sharing. ParCuR adapts reuse to work sharing in four aspects: i) to reduce filtering costs, it builds access methods on materialized results, ii) to resolve the conflict between benefits from work sharing and materialization, it introduces a sharing-aware materialization policy, iii) to incorporate reuse into sharing-aware optimization, it introduces a two-phase optimization strategy, and iv) to improve reusability and to avoid performance cliffs when queries are partially covered, especially during workload shifts, it combines partial reuse with data clustering based on historical batches. ParCuR outperforms a state-of-the-art work-sharing database by 6.4x and 2x in the SSB and TPC-H benchmarks respectively

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑