arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.07428cs.DC
收藏

UNR:面向HPC的统一可通知RMA库

UNR: Unified Notifiable RMA Library for HPC

Sun Yat-sen University(中山大学);National Laboratory for Parallel and Distributed Processing (PDL)(并行与分布式处理国家重点实验室)

Guangnan Feng, Jiabin Xie, Dezun Dong, Yutong Lu

AI总结:

针对HPC中RMA操作缺少完成通知机制的问题,提出统一可通知RMA库UNR,解决多NIC聚合、可移植性等挑战,并在PowerLLEL应用中验证,在1728节点上实现36%加速。

摘要:

远程内存访问(RMA)能够直接访问远程内存,从而为HPC应用实现高性能。然而,大多数现代并行编程模型缺乏远程进程检测RMA操作完成的机制。许多先前的工作提出了编程模型和扩展来通知通信对端,但这些工作未能解决多NIC聚合、可移植性、硬件-软件协同设计以及可用性问题。在本工作中,我们提出了一个面向HPC的统一可通知RMA(UNR)库,以应对这些挑战。此外,我们展示了在真实科学应用PowerLLEL中利用UNR的最佳实践。我们将UNR部署在四个HPC系统上,每个系统具有不同的互连网络。结果表明,由UNR驱动的PowerLLEL在天津之星超级计算系统的1728个节点上实现了高达36%的加速。

英文摘要:

Remote Memory Access (RMA) enables direct access to remote memory to achieve high performance for HPC applications. However, most modern parallel programming models lack schemes for the remote process to detect the completion of RMA operations. Many previous works have proposed programming models and extensions to notify the communication peer, but they did not solve the multi-NIC aggregation, portability, hardware-software co-design, and usability problems. In this work, we proposed a Unified Notifiable RMA (UNR) library for HPC to address these challenges. In addition, we demonstrate the best practice of utilizing UNR within a real-world scientific application, PowerLLEL. We deployed UNR across four HPC systems, each with a different interconnect. The results show that PowerLLEL powered by UNR achieves up to a 36% acceleration on 1728 nodes of the Tianhe-Xingyi supercomputing system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑