arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.11432cs.DC
收藏

刻画现代HPC互连中的拥堵影响

Characterizing the Impact of Congestion in Modern HPC Interconnects

Sapienza University of Rome(罗马第一大学);ENEA(意大利国家新技术、能源和可持续发展环境委员会);University of Groningen(格罗宁根大学);Huawei(华为);CINECA(CINECA超级计算中心)

Lorenzo Piarulli, Marco Faltelli, Dirk Pleiter, Karthee Sivalingam, Dancheng Zhang, Kexue Zhao, Matteo Turisini, Francesco Iannone, Aldo Artigiani, Daniele De Sensi

AI总结:

本文研究了现代HPC互连技术在拥堵下的表现,通过分析四种主要互连技术的响应,揭示了拥堵对大规模计算性能的影响及优化方向。

摘要:

高性能计算(HPC)系统日益支持可扩展的AI训练和大规模模拟工作负载,二者均严重依赖集体通信操作。然而,在现代超级计算机中,网络拥堵已成为主要限制因素,由异构交通模式驱动。随着系统规模和活跃用户的增长,理解当今互连技术如何应对拥堵对建立现实的性能预期和指导未来系统设计至关重要。本文对四种主要HPC互连技术进行了全面分析:EDR InfiniBand、HDR InfiniBand、NDR InfiniBand、Cray Slingshot以及新兴的以太网互连。这些互连技术涵盖了高性能专有互连以及符合新兴标准如Ultra Ethernet的自适应以太网设计。我们评估了它们在稳定拥堵和多种突发模式下的响应,捕捉了AI工作负载中典型的突发通信。本研究覆盖多个规模,探讨了拥堵在系统规模增大时的不同表现,并识别了影响集体性能的规模依赖行为。通过分析在受控压力条件下出现的挑战,我们旨在提供拥堵问题的实用概述和可能的优化方向。由此得出的见解可指导研究人员和HPC架构师设计更有效的拥堵控制机制和网络负载均衡策略。

英文摘要:

High-performance computing (HPC) systems increasingly support both scalable AI training and large-scale simulation workloads. Both typically rely heavily on collective communication operations. On modern supercomputers, however, network congestion has emerged as a major limitation, driven by heterogeneous traffic patterns resulting from diverse workload mixes. As system scale and active users continue to grow, understanding how today's interconnect technologies respond to congestion is essential for establishing realistic performance expectations and informing future system design. This paper presents a comprehensive characterization of congestion behavior across four major HPC fabrics: EDR InfiniBand, HDR InfiniBand, NDR InfiniBand, Cray Slingshot, and emerging Ethernet fabrics. These fabrics span high-performance proprietary interconnects as well as adaptive Ethernet-based designs aligned with emerging standards such as Ultra Ethernet. We evaluate their responses to both steady congestion and a wide range of bursty patterns that vary in duration, intensity, and pause length, capturing the bursty communication typical of AI workloads. Our study covers multiple scales, examining how congestion manifests differently as system size increases and identifying scale-dependent behaviors that influence collective performance. By analyzing the challenges that arise under these controlled stress conditions, we aim to provide a practical overview of congestion issues and possible optimizations. The insights derived from this evaluation can guide researchers and HPC architects in designing more effective congestion-control mechanisms and network load-balancing strategies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑