MT-lib:一个面向超级计算机Graph500的拓扑感知消息传递库
MT-lib: A Topology-aware Message Transfer Library for Graph500 on Supercomputers
摘要:
我们提出了MT-lib,一个高效的消息传输库,用于在超级计算机的Graph 500等基准测试中收集和分散消息。我们的图书馆包括MST版本以及新的MST版本。MT-lib是故意保持轻量级,高效和友好的接口,为大量的图形遍历。MST提供了(1)一种新的非阻塞通信方案,异步发送和接收消息,以重叠计算和通信;(2)根据目标进程合并消息,以减少通信开销;(3)一种新的通信模式,在组间转发之前收集组内消息,以减少通信流量。在MT-lib中,有(1)单侧消息;(2)双侧消息;(3)带缓冲区的双侧消息,其中为消息传递建立了动态缓冲区扩展。我们在天河超级计算机上试验了MST,然后用MST测试了Graph 500。实验结果表明,高通信效率和高吞吐量的BFS和SSSP通信操作。
英文摘要:
We present MT-lib, an efficient message transfer library for messages gather and scatter in benchmarks like Graph500 for Supercomputers. Our library includes MST version as well as new-MST version. The MT-lib is deliberately kept light-weight, efficient and friendly interfaces for massive graph traverse. MST provides (1) a novel non-blocking communication scheme with sending and receiving messages asynchronously to overlap calculation and communication;(2) merging messages according to the target process for reducing communication overhead;(3) a new communication mode of gathering intra-group messages before forwarding between groups for reducing communication traffic. In MT-lib, there are (1) one-sided message; (2) two-sided messages; and (3) two-sided messages with buffer, in which dynamic buffer expansion is built for messages delivery. We experimented with MST and then testing Graph500 with MST on Tianhe supercomputers. Experimental results show high communication efficiency and high throughputs for both BFS and SSSP communication operations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。