arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.08236cs.DC
收藏

NetChain:无标度子RTT协调(扩展版)

NetChain: Scale-Free Sub-RTT Coordination (Extended Version)

Xin Jin, Xiaozhou Li, Haoyu Zhang, Nate Foster, Jeongkeun Lee, Robert Soule, Changhoon Kim, Ion Stoica

摘要:

协调服务是现代云系统的基本构建块,提供配置管理和分布式锁定等关键功能。主要的挑战是实现低延迟和高吞吐量,同时提供强大的一致性和容错性。传统的基于服务器的解决方案需要多个往返时间(RTT)来处理查询。本文介绍了NetChain,一种新的方法,提供了无标度的子RTT协调的数据中心。NetChain利用可编程交换机的最新进展,完全在网络数据平面中存储数据和处理查询。这消除了协调服务器的查询处理,并将端到端延迟减少到RTT的一半-客户端只经历来自其自己的软件堆栈的处理延迟加上网络延迟,在数据中心设置中通常要小得多。我们设计了新的协议和算法的基础上链复制,以保证强一致性,并有效地处理交换机故障。我们实现了一个原型与四个赤脚Tofino交换机和四个商品服务器。评估结果表明,与传统的基于服务器的解决方案,如ZooKeeper相比,我们的原型提供了数量级更高的吞吐量和更低的延迟,并优雅地处理故障。

英文摘要:

Coordination services are a fundamental building block of modern cloud systems, providing critical functionalities like configuration management and distributed locking. The major challenge is to achieve low latency and high throughput while providing strong consistency and fault-tolerance. Traditional server-based solutions require multiple round-trip times (RTTs) to process a query. This paper presents NetChain, a new approach that provides scale-free sub-RTT coordination in datacenters. NetChain exploits recent advances in programmable switches to store data and process queries entirely in the network data plane. This eliminates the query processing at coordination servers and cuts the end-to-end latency to as little as half of an RTT---clients only experience processing delay from their own software stack plus network delay, which in a datacenter setting is typically much smaller. We design new protocols and algorithms based on chain replication to guarantee strong consistency and to efficiently handle switch failures. We implement a prototype with four Barefoot Tofino switches and four commodity servers. Evaluation results show that compared to traditional server-based solutions like ZooKeeper, our prototype provides orders of magnitude higher throughput and lower latency, and handles failures gracefully.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑