arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1904.00513cs.NI
收藏

优化低延迟网络拓扑以提高集群性能

Optimal Low-Latency Network Topologies for Cluster Performance Enhancement

Yuefan Deng, Meng Guo, Alexandre F. Ramos, Xiaolong Huang, Zhipeng Xu, Weifeng Liu

摘要:

我们建议,具有最小平均路径长度的网络拓扑结构互连的集群将增加其整体性能的各种应用。我们接近我们的启发式通过构建集群的蜻蜓,环面,环,Chvatal,瓦格纳,Bidiakis和其他几个拓扑结构具有最小的平均路径长度和256个节点的集群与相同的网络拓扑结构的性能进行模拟。通过最小化正则图的平均路径长度,找到最优(或次优)低延迟网络拓扑。所选的拓扑使用乒乓消息,MPI集体通信,和标准的并行应用程序,包括有效带宽,FFTE,图形500和NAS并行基准进行基准测试。我们建立了集群的性能和网络拓扑结构之间的强相关性,特别是平均路径长度,为广泛的应用。在通信密集型基准测试中,具有最佳网络拓扑的集群的性能比具有主流拓扑的集群高出数倍。令人惊讶的是,仅仅调整网络拓扑结构就足以从相同的计算硬件中恢复性能。

英文摘要:

We propose that clusters interconnected with network topologies having minimal mean path length will increase their overall performance for a variety of applications. We approach our heuristic by constructing clusters of up to 36 nodes having Dragonfly, torus, ring, Chvatal, Wagner, Bidiakis and several other topologies with minimal mean path lengths and by simulating the performance of 256-node clusters with the same network topologies. The optimal (or sub-optimal) low-latency network topologies are found by minimizing the mean path length of regular graphs. The selected topologies are benchmarked using ping-pong messaging, the MPI collective communications, and the standard parallel applications including effective bandwidth, FFTE, Graph 500 and NAS parallel benchmarks. We established strong correlations between the clusters' performances and the network topologies, especially the mean path lengths, for a wide range of applications. In communication-intensive benchmarks, clusters with optimal network topologies out-perform those with mainstream topologies by several folds. It is striking that a mere adjustment of the network topology suffices to reclaim performance from the same computing hardware.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑