arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.01327cs.DC
收藏

Zeus:本地感知分布式事务

Zeus: Locality-aware Distributed Transactions

Antonios Katsarakis, Yijun Ma, Zhaowei Tan, Andrew Bainbridge, Matthew Balkwill, Aleksandar Dragojevic, Boris Grot, Bozidar Radunovic, Yongguang Zhang

摘要:

最先进的分布式内存数据存储(FaRM、FaSST、DrTM)提供了具有高性能和高可用性的强一致性分布式事务。这些系统中的事务是完全通用的;它们可以原子地操作存储中的任何对象集,而不管它们的位置。为了实现这一点,这些系统使用复杂的分布式事务协议。同时,许多工作负载具有高度的局部性。对于这样的工作负载,分布式事务是一种矫枉过正的做法,因为大多数操作只访问位于同一服务器上的对象--如果分片适当的话。在本文中,我们表明,对于这些工作负载,单节点事务协议结合动态对象重新分片和异步流水线复制可以提供相同水平的通用性,更好的性能,更简单的协议,和更低的开发人员的努力。我们提出了宙斯,一个内存中的分布式的交易,提供一般的交易,通过获取所有对象中涉及的事务到同一个服务器上,并执行一个单节点的事务。Zeus具有容错性和强一致性。Zeus的核心是一个可靠的动态对象分片协议,每个服务器每秒可以移动25万个对象,使Zeus能够每秒处理数百万个事务,并在表现出局部性的各种工作负载上优于传统的分布式事务。

英文摘要:

State-of-the-art distributed in-memory datastores (FaRM, FaSST, DrTM) provide strongly-consistent distributed transactions with high performance and availability. Transactions in those systems are fully general; they can atomically manipulate any set of objects in the store, regardless of their location. To achieve this, these systems use complex distributed transactional protocols. Meanwhile, many workloads have a high degree of locality. For such workloads, distributed transactions are an overkill as most operations only access objects located on the same server -- if sharded appropriately. In this paper, we show that for these workloads, a single-node transactional protocol combined with dynamic object re-sharding and asynchronously pipelined replication can provide the same level of generality with better performance, simpler protocols, and lower developer effort. We present Zeus, an in-memory distributed datastore that provides general transactions by acquiring all objects involved in the transaction to the same server and executing a single-node transaction on them. Zeus is fault-tolerant and strongly-consistent. At the heart of Zeus is a reliable dynamic object sharding protocol that can move 250K objects per second per server, allowing Zeus to process millions of transactions per second and outperform more traditional distributed transactions on a wide range of workloads that exhibit locality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑