arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0402027cs.DCcs.AR
收藏

基于NIC的集合消息传递协议在二次曲面和Myrinet上的高效可扩展屏障

Efficient and Scalable Barrier over Quadrics and Myrinet with a New NIC-Based Collective Message Passing Protocol

Weikuan Yu, Darius Buntinas, Rich L. Graham, Dhabaleswar K. Panda

摘要:

现代互连通常在网络接口中具有可编程处理器,其可用于从主机CPU卸载通信处理。在本文中,我们探讨了不同的计划,以支持集体操作在网络接口,并提出了一个新的集体协议。屏障作为一个初步的案例研究,我们已经证明,大部分的通信处理可以大大简化与这个集体协议。因此,%与我们提出的集体处理方案,我们已经设计并实现了高效和可扩展的NIC为基础的屏障操作两个高性能的互连,二次和Myrinet。我们的评估表明,在一个由8个节点组成的Quadrics集群上,基于NIC的屏障操作实现的屏障延迟仅为5.60 $μ$ s。这个结果比基于Elanlib树的屏障操作提高了2.48倍。在具有LANai-XP NIC卡的8个节点的Myrinet集群上,在8个节点上实现了14.20 $μ$ s的屏障延迟。这比基于主机的屏障算法提高了2.64倍。此外,为所提出的方案开发的分析模型表明,基于NIC的屏障操作可以在1024个节点的集群上执行,只有22.13 $μ$ s的延迟在Quadrics和38.94 $μ$ s的延迟在Myrinet。这些结果表明,为下一代集群开发高性能的通信子系统的潜力。

英文摘要:

Modern interconnects often have programmable processors in the network interface that can be utilized to offload communication processing from host CPU. In this paper, we explore different schemes to support collective operations at the network interface and propose a new collective protocol. With barrier as an initial case study, we have demontrated that much of the communication processing can be greatly simplified with this collective protocol. Accordingly, %with our proposed collective processing scheme, we have designed and implemented efficient and scalable NIC-based barrier operations over two high performance interconnects, Quadrics and Myrinet. Our evaluation shows that, over a Quadrics cluster of 8 nodes with ELan3 Network, the NIC-based barrier operation achieves a barrier latency of only 5.60$μ$s. This result is a 2.48 factor of improvement over the Elanlib tree-based barrier operation. Over a Myrinet cluster of 8 nodes with LANai-XP NIC cards, a barrier latency of 14.20$μ$s over 8 nodes is achieved. This is a 2.64 factor of improvement over the host-based barrier algorithm. Furthermore, an analytical model developed for the proposed scheme indicates that a NIC-based barrier operation on a 1024-node cluster can be performed with only 22.13$μ$s latency over Quadrics and with 38.94$μ$s latency over Myrinet. These results indicate the potential for developing high performance communication subsystems for next generation clusters.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑