Lotus:通过解耦锁优化解耦事务
Lotus: Optimizing Disaggregated Transactions with Disaggregated Locks
AI总结:
Lotus通过解耦锁优化分布式事务,提升事务吞吐量和降低延迟。
摘要:
解耦内存(DM)将计算和内存资源分离,允许灵活扩展以实现高资源利用率。为了确保在DM上实现原子性和一致性的数据访问,分布式事务系统已被适应,其中计算节点(CNs)依赖于单向RDMA操作来访问内存节点(MNs)中的远程数据。然而,我们发现现有事务系统中,MNs的RDMA网络接口卡成为性能瓶颈。该瓶颈源于大量用于锁的单向原子操作,阻碍了系统高效扩展的能力。为了解决这个问题,本文提出了Lotus,一种可扩展的分布式事务系统,其在DM上实现了锁的解耦。Lotus的关键创新是将锁从数据中解耦,并在CNs上执行所有锁,从而消除MNs RNICs的瓶颈。为了在CNs上实现高效的锁管理,Lotus采用了一种应用感知的锁管理机制,利用OLTP工作负载的局部性来分片锁,同时保持负载平衡。为了确保在锁解耦情况下的一致事务处理,Lotus引入了锁优先的事务协议,该协议将锁阶段作为每个读写事务执行的第一步。该协议允许系统在锁获取成功时尽早确定,并主动中止冲突事务,提高整体效率。为了容忍CN故障期间的锁丢失,Lotus采用了一种无锁重建的恢复机制,将锁视为短暂存在,避免其重建,从而确保CN故障的轻量级恢复。实验结果表明,与最先进的DM事务系统相比,Lotus将事务吞吐量提高了高达2.1倍,将延迟降低了高达49.4%。
英文摘要:
Disaggregated memory (DM) separates compute and memory resources, allowing flexible scaling to achieve high resource utilization. To ensure atomic and consistent data access on DM, distributed transaction systems have been adapted, where compute nodes (CNs) rely on one-sided RDMA operations to access remote data in memory nodes (MNs). However, we observe that in existing transaction systems, the RDMA network interface cards at MNs become a primary performance bottleneck. This bottleneck arises from the high volume of one-sided atomic operations used for locks, which hinders the system's ability to scale efficiently. To address this issue, this paper presents Lotus, a scalable distributed transaction system with lock disaggregation on DM. The key innovation of Lotus is to disaggregate locks from data and execute all locks on CNs, thus eliminating the bottleneck at MN RNICs. To achieve efficient lock management on CNs, Lotus employs an application-aware lock management mechanism that leverages the locality of the OLTP workloads to shard locks while maintaining load balance. To ensure consistent transaction processing with lock disaggregation, Lotus introduces a lock-first transaction protocol, which separates the locking phase as the first step in each read-write transaction execution. This protocol allows the system to determine the success of lock acquisitions early and proactively abort conflicting transactions, improving overall efficiency. To tolerate lock loss during CN failures, Lotus employs a lock-rebuild-free recovery mechanism that treats locks as ephemeral and avoids their reconstruction, ensuring lightweight recovery for CN failures. Experimental results demonstrate that Lotus improves transaction throughput by up to 2.1$\times$ and reduces latency by up to 49.4% compared to state-of-the-art transaction systems on DM.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。