arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.08006cs.DC

迈向统一的支持GPU的OpenSHMEM规范

Toward a Unified GPU-Aware OpenSHMEM Specification

Hewlett Packard Enterprise (HPE)(惠普企业);Advanced Micro Devices, Inc.(超威半导体公司)
Naveen Ravi, Nathan Wichmann, Md. Wasi-ur- Rahman, Aurelien Bouteiller, Yıltan Hassan Temuçin, Avinash Kethineedi, Johnathan Alsop, Brandon Potter, Shubhendra P… 展开作者

Naveen Ravi, Nathan Wichmann, Md. Wasi-ur- Rahman, Aurelien Bouteiller, Yıltan Hassan Temuçin, Avinash Kethineedi, Johnathan Alsop, Brandon Potter, Shubhendra Pal Singhal, Jun Shirako, Akihiro Hayashi, Vivek Sarkar, Lawrence C. Stewart, Michael Beebe, Benjamin Michalowicz, Jeongnim Kim, Thiago Teixeria, Mark F. Brown, Aaron Welch, Oscar Hernandez, Wendy Poole, Steve Poole

AI总结:

研究针对领导级HPC系统中GPU内存模型缺乏可移植语义的问题,提出支持GPU通信的OpenSHMEM辅助规范,通过扩展内存模型等方式,实现跨多供应商GPU的语义指定与实现,迈向规范统一。

摘要:

领导级HPC系统如今以加速器为中心,GPU提供了大部分浮点吞吐量和内存带宽。随着下一代系统通过高速内存结构和系统互连越来越多地集成加速器,像OpenSHMEM这样的PGAS模型为跨设备表达细粒度远程内存操作提供了自然抽象。OpenSHMEM 1.x虽提供了用于不规则通信、原子操作、细粒度同步和集合操作的精简PGAS模型,但其内存模型缺乏针对加速器架构的可移植语义。现有支持GPU的OpenSHMEM实现存在差异,限制了可移植性和生态系统凝聚力。本文提出了用于支持GPU通信的OpenSHMEM辅助规范,作为对OpenSHMEM 1.x的轻量级、向后兼容扩展。该规范通过GPU范围的内存空间抽象引入了最小内存模型扩展,以及能力查询和在RMA、原子、同步和集合操作中使用GPU连接缓冲区的明确定义语义。最初通过主机发起接口构想,也允许可选的设备发起支持。核心目标是证明支持GPU的OpenSHMEM语义可在多个供应商的GPU上指定和实现,朝着统一迈出实用且可快速实现的一步,并为未来规范设计提供参考。

英文摘要:

Leadership-class HPC systems are now accelerator-centric, with GPUs providing most floating-point throughput and memory bandwidth. As next-generation systems increasingly integrate accelerators through high-speed memory fabrics and system interconnects, exposing larger tightly coupled device domains, \ac{PGAS} models such as OpenSHMEM provide a natural abstraction for expressing fine-grained remote memory operations across these devices. While OpenSHMEM 1.x offers a lean PGAS model for irregular communication, atomics, fine-grained synchronization, and collectives, its memory model lacks portable semantics for accelerator architectures. As a result, existing GPU-enabled OpenSHMEM implementations differ in memory management, capability discovery, and operation semantics, limiting portability and ecosystem cohesion. This risks fracturing the community that OpenSHMEM was originally created to unify. This paper proposes an OpenSHMEM Auxiliary Specification for GPU-Aware Communication, designed as a lightweight, backward-compatible extension to OpenSHMEM 1.x. The auxiliary specification introduces a minimal memory model extension via a GPU-scoped memory space abstraction, along with capability queries and well-defined semantics for using \acs{GPU}-attached buffers in RMA, atomic, synchronization, and collective operations. This is initially conceived through the lens of a host-initiated interface, although it provides a general set of semantics that also allow for optional device-initiated support. A central goal of this effort is to demonstrate that GPU-aware OpenSHMEM semantics can be specified and implemented across GPUs from multiple vendors, providing a practical and rapidly implementable step toward unification under a vendor-neutral specification while informing the design of future OpenSHMEM specifications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑