arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.19440cs.DB
收藏

突破数据库无关事务的障碍

Breaking the Barriers of Database-Agnostic Transactions

Scalar, Inc.(Scalar公司)

Toshihiro Suzuki, Hiroyuki Yamada

AI总结:

本文提出原子性单元(AU)概念,通过下推数据库操作提升性能并实现事务元数据与应用数据的高效分离,从而解决数据库无关事务管理中的性能优化和模式迁移问题。

摘要:

联邦事务管理长期以来被用作从事务视角虚拟整合多个数据库的方法,以确保数据库之间的一致性。现代方法在数据库抽象层上管理事务以实现数据库无关性;然而,这些方法面临几个挑战。首先,在数据库抽象层上管理事务使性能优化变得困难,因为抽象层隐藏了底层数据库的细节,例如数据库特定的功能。此外,它要求应用程序数据和相关的事务元数据必须在同一记录中 colocated 以允许高效的更新,这需要对现有数据库进行模式迁移才能在现有数据库上运行联邦事务。本文介绍了这种数据库抽象层中的新概念,称为原子性单元(AU),以解决这些挑战。AU使联邦事务管理能够激进地将数据库操作下推,通过利用其在可原子执行范围内执行操作的知识,充分利用数据库的性能。此外,AU使事务元数据与应用程序数据高效分离,使联邦事务能够在现有数据库上运行,而无需进行模式迁移或显著的性能下降。在本文中,我们描述了AU,AU如何解决这些挑战,以及其在ScalarDB中的实现,ScalarDB是一个开源的数据库无关联邦事务管理器。我们还展示了评估结果,证明ScalarDB与AU在性能和元数据分离方面显著优于现有方法。

英文摘要:

Federated transaction management has long been used as a method to virtually integrate multiple databases from a transactional perspective, ensuring consistency across the databases. Modern approaches manage transactions on top of a database abstraction to achieve database agnosticism; however, these approaches face several challenges. First, managing transactions on top of a database abstraction makes performance optimization difficult because the abstraction hides away the details of underlying databases, such as database-specific capabilities. Additionally, it requires that application data and the associated transaction metadata be colocated in the same record to allow for efficient updates, necessitating a schema migration to run federated transactions on top of existing databases. This paper introduces a new concept in such database abstraction called Atomicity Unit (AU) to address these challenges. AU enables federated transaction management to aggressively pushdown database operations by making use of the knowledge about the scope within which they can perform operations atomically, fully harnessing the performance of the databases. Moreover, AU enables efficient separation of transaction metadata from application data, allowing federated transactions to run on existing databases without requiring a schema migration or significant performance degradation. In this paper, we describe AU, how AU addresses the challenges, and its implementation within ScalarDB, an open-sourced database-agnostic federated transaction manager. We also present evaluation results demonstrating that ScalarDB with AU achieves significantly better performance and efficient metadata separation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑