SDR-RDMA:面向行星级RDMA通信的软件定义可靠性架构
SDR-RDMA: Software-Defined Reliability Architecture for Planetary Scale RDMA Communication
AI总结:
针对长距离RDMA通信中传统选择性重传效率低下的问题,本文提出SDR-RDMA软件定义可靠性架构,通过接收缓冲区位图扩展RDMA语义并利用NVIDIA DPA卸载实现线速性能,支持自定义可靠性方案以提升跨数据中心训练效率。
摘要:
RDMA对于跨数据中心的分布式训练至关重要,但毫秒级延迟使其可靠性层的设计变得复杂。我们表明,根据长距离链路特征(如丢包率、距离和带宽),广泛使用的选择性重传(Selective Repeat)算法可能效率低下,因此需要纠删码(Erasure Coding)等替代方案。为了在现有硬件上支持这些替代方案,我们提出了SDR-RDMA,一个面向RDMA的软件定义可靠性栈。其核心是一个轻量级SDR SDK,它通过接收缓冲区位图扩展了标准点对点RDMA语义——这是AI网络栈的基础。SDR位图支持部分消息完成,使应用程序能够实现针对特定部署定制的自定义可靠性方案,同时保留零拷贝RDMA优势。通过将SDR后端卸载到NVIDIA的数据路径加速器(DPA),我们实现了线速性能,从而支持高效的数据中心间通信,并推动数据中心间训练的可靠性创新。
英文摘要:
RDMA is vital for efficient distributed training across datacenters, but millisecond-scale latencies complicate the design of its reliability layer. We show that depending on long-haul link characteristics, such as drop rate, distance and bandwidth, the widely used Selective Repeat algorithm can be inefficient, warranting alternatives like Erasure Coding. To enable such alternatives on existing hardware, we propose SDR-RDMA, a software-defined reliability stack for RDMA. Its core is a lightweight SDR SDK that extends standard point-to-point RDMA semantics -- fundamental to AI networking stacks -- with a receive buffer bitmap. SDR bitmap enables partial message completion to let applications implement custom reliability schemes tailored to specific deployments, while preserving zero-copy RDMA benefits. By offloading the SDR backend to NVIDIA's Data Path Accelerator (DPA), we achieve line-rate performance, enabling efficient inter-datacenter communication and advancing reliability innovation for inter-datacenter training.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。