arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.15565cs.DCcs.ARcs.NI
收藏

Flare:灵活的网络内Allreduce

Flare: Flexible In-Network Allreduce

Daniele De Sensi, Salvatore Di Girolamo, Saleh Ashkboos, Shigang Li, Torsten Hoefler

摘要:

allreduce操作是分布式应用程序中最常用的通信例程之一。为了提高其带宽并减少网络流量,可以通过将其卸载到网络交换机来加速此操作,网络交换机聚合从主机接收的数据,并将聚合结果发送回主机。然而,现有的解决方案提供的定制机会有限,并且在处理自定义运算符和数据类型、稀疏数据或聚合的可重复性令人担忧时可能会提供次优性能。为了解决这些问题,在这项工作中,我们设计了一个灵活的可编程开关作为构建块PsPIN,RISC-V架构实现的sPIN编程模型。然后,我们设计,模型,并分析不同的算法执行聚合在这个架构上,显示性能的改进相比,国家的最先进的方法。

英文摘要:

The allreduce operation is one of the most commonly used communication routines in distributed applications. To improve its bandwidth and to reduce network traffic, this operation can be accelerated by offloading it to network switches, that aggregate the data received from the hosts, and send them back the aggregated result. However, existing solutions provide limited customization opportunities and might provide suboptimal performance when dealing with custom operators and data types, with sparse data, or when reproducibility of the aggregation is a concern. To deal with these problems, in this work we design a flexible programmable switch by using as a building block PsPIN, a RISC-V architecture implementing the sPIN programming model. We then design, model, and analyze different algorithms for executing the aggregation on this architecture, showing performance improvements compared to state-of-the-art approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑