基于TestSNAP和LAMMPS的高级体系结构优化策略快速探索
Rapid Exploration of Optimization Strategies on Advanced Architectures using TestSNAP and LAMMPS
摘要:
随着Aurora和Frontier机器的宣布,艾级竞赛已经结束。下一代超级计算机利用不同的硬件架构来实现其计算性能,为应用程序的性能可移植性提供了额外的负担。如果不是性能可移植框架的发展,编程模型的扩展碎片将提供一个复合优化挑战,提供统一的模型来将并行的抽象层次映射到不同的体系结构。这个挑战的一个解决方案是性能可移植框架的发展,提供统一的模型,用于将并行性的抽象层次映射到不同的体系结构。Kokkos是一种用于C++应用程序的性能可移植编程模型,为每个主要HPC平台提供后端实现。即使使用性能可移植的框架,重新构造算法以暴露更高程度的并行性也不是微不足道的。光谱近邻分析势(SNAP)是一种用于尖端分子动力学模拟的机器学习原子间势。以前的SNAP计算实现显示出相对于新一代CPU上的峰值和GPU上的低性能,其性能呈下降趋势。在本文中,我们描述了SNAP的重组和优化,在LAMMPS分子动力学软件包的Kokkos CUDA后端实现,以NVIDIA GPU为基准。我们确定新的模式的层次并行,促进内存访问开销最小化,并推动实施到一个计算饱和的制度。我们通过Kokkos的实现可以在即将到来的架构上实现重新编译和运行效率。在NVIDIA Tesla V100- 16 GB的一项重要基准测试中,我们发现,相对于现有实施方案,$\sim$的解决时间缩短了$\sim$ 22倍。
英文摘要:
The exascale race is at an end with the announcement of the Aurora and Frontier machines. This next generation of supercomputers utilize diverse hardware architectures to achieve their compute performance, providing an added onus on the performance portability of applications. An expanding fragmentation of programming models would provide a compounding optimization challenge were it not for the evolution of performance-portable frameworks, providing unified models for mapping abstract hierarchies of parallelism to diverse architectures. A solution to this challenge is the evolution of performance-portable frameworks, providing unified models for mapping abstract hierarchies of parallelism to diverse architectures. Kokkos is one such performance portable programming model for C++ applications, providing back-end implementations for each major HPC platform. Even with a performance portable framework, restructuring algorithms to expose higher degrees of parallelism is non-trivial. The Spectral Neighbor Analysis Potential (SNAP) is a machine-learned inter-atomic potential utilized in cutting-edge molecular dynamics simulations. Previous implementations of the SNAP calculation showed a downward trend in their performance relative to peak on newer-generation CPUs and low performance on GPUs. In this paper we describe the restructuring and optimization of SNAP as implemented in the Kokkos CUDA backend of the LAMMPS molecular dynamics package, benchmarked on NVIDIA GPUs. We identify novel patterns of hierarchical parallelism, facilitating a minimization of memory access overheads and pushing the implementation into a compute-saturated regime. Our implementation via Kokkos enables recompile-and-run efficiency on upcoming architectures. We find a $\sim$22x time-to-solution improvement relative to an existing implementation as measured on an NVIDIA Tesla V100-16GB for an important benchmark.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。