利用SmartNIC的数据路径加速器实现有序键值存储
Employ SmartNICs' Data Path Accelerators for Ordered Key-Value Stores
AI总结:
本文提出一种利用SmartNIC数据路径加速器实现高性能有序键值存储,支持无状态客户端和范围查询,达到每秒3300万次点查找和13万次范围查询的性能。
摘要:
远程内存键值(KV)存储是多种现代工作负载的基础,高速范围扫描通常是其需求。然而,当前架构 rarely 实现峰值效率、架构简单性和原生支持有序操作的平衡。传统以主机为中心的框架受限于内核空间网络堆栈和内部总线延迟。虽然基于哈希的替代方案利用操作系统绕过或直接在SmartNIC上运行,提供了高吞吐量,但缺乏支持范围查询的数据结构。基于RDMA的分布式系统提供了性能和范围功能,但通常依赖于状态机客户端,这在扩展和错误处理上引入了复杂性。另一种SmartNIC实现,遍历位于主机内存中的树,受到高DMA往返延迟的限制。本文介绍了一种KV存储,利用BlueField-3 SmartNIC的数据路径加速器(DPAs)来消除操作系统开销,同时支持无状态客户端和范围操作。这些DPAs直接从NIC缓冲区摄入网络请求,以导航位于加速器本地内存中的无锁学习索引。通过将值检索从主机侧树副本推迟到到达叶级别时,设计减少了PCIe交叉。写操作在DPA内存中暂存,并批量迁移至主机,在主机上进行结构维护后,再通过事务缝合回SmartNIC。结合NIC驻留的读缓存,系统实现了每秒3300万次操作(MOPS)的点查找和每秒13万次范围查询。我们的分析表明,该架构与当前最先进的解决方案相匹配或超越,同时我们识别出硬件改进可以进一步加速性能。
英文摘要:
Remote in-memory key-value (KV) stores serve as a cornerstone for diverse modern workloads, and high-speed range scans are frequently a requirement. However, current architectures rarely achieve a simultaneous balance of peak efficiency, architectural simplicity, and native support for ordered operations. Conventional host-centric frameworks are restricted by kernel-space network stacks and internal bus latencies. While hash-based alternatives that utilize OS-bypass or run natively on SmartNICs offer high throughput, they lack the data structures necessary for range queries. Distributed RDMA-based systems provide performance and range functionality but often depend on stateful clients, which introduces complexity in scaling and error handling. Alternatively, SmartNIC implementations that traverse trees located in host memory are hampered by high DMA round-trip latencies. This paper introduces a KV store that leverages the on-path Data Path Accelerators (DPAs) of the BlueField-3 SmartNIC to eliminate operating system overhead while facilitating stateless clients and range operations. These DPAs ingest network requests directly from NIC buffers to navigate a lock-free learned index residing in the accelerator's local memory. By deferring value retrieval from the host-side tree replica until the leaf level is reached, the design minimizes PCIe crossings. Write operations are staged in DPA memory and migrated in batches to the host, where structural maintenance is performed before being transactionally stitched back to the SmartNIC. Coupled with a NIC-resident read cache, the system achieves 33 million operations per second (MOPS) for point lookups and 13 MOPS for range queries. Our analysis demonstrates that this architecture matches or exceeds the performance of contemporary state-of-the-art solutions, while we identify hardware refinements that could further accelerate performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。