面向现代多核系统的FASTEST-3D优化
Optimization of FASTEST-3D for Modern Multicore Systems
摘要:
FASTEST-3D是一种基于块结构网格的MPI并行有限体积流解算器,自20世纪90年代初以来一直在埃尔朗根-纽伦堡大学开发。它可用于求解层流或湍流不可压Navier-Stokes方程。到目前为止,它的可扩展性受到相当严格的通信基础设施的强烈限制,这导致MPI时间已经在小进程计数中占据主导地位。本文介绍了几种提高FASTEST-3D性能、可扩展性和灵活性的优化。首先,进行节点级性能分析,以查明主要瓶颈并确定节能执行的最佳点。此外,单精度版本的求解器的线性方程组所产生的离散化的控制方程的设计,这显着提高了单核性能。分析了FASTEST-3D的通信机制,提出了一种基于非阻塞调用的通信策略。修订后的版本的性能结果表明,显着提高了单节点的性能和显着改善的通信模式,以及更好的并行可扩展性。在这种情况下,我们讨论的概念“可接受的并行效率”,以及它如何影响优化的实际收益。标度测量是在一个现代化的千万亿次系统上进行的。所获得的改进对于在当前高性能计算机集群上使用FASREST-3D至关重要,并将有助于以更高的空间和时间分辨率执行模拟,以解决技术应用中的湍流问题。
英文摘要:
FASTEST-3D is an MPI-parallel finite-volume flow solver based on block-structured meshes that has been developed at the University of Erlangen-Nuremberg since the early 1990s. It can be used to solve the laminar or turbulent incompressible Navier-Stokes equations. Up to now its scalability was strongly limited by a rather rigid communication infrastructure, which led to a dominance of MPI time already at small process counts. This paper describes several optimizations to increase the performance, scalability, and flexibility of FASTEST-3D. First, a node-level performance analysis is carried out in order to pinpoint the main bottlenecks and identify sweet spots for energy-efficient execution. In addition, a single-precision version of the solver for the linear equation system arising from the discretization of the governing equations is devised, which significantly increases the single-core performance. Then the communication mechanisms in FASTEST-3D are analyzed and a new communication strategy based on non-blocking calls is implemented. Performance results with the revised version show significantly increased single-node performance and considerably improved communication patterns along with much better parallel scalability. In this context we discuss the concept of "acceptable parallel efficiency" and how it influences the real gain of the optimizations. Scaling measurements are carried out on a modern petascale system. The obtained improvements are of major importance for the use of FASTEST-3D on current high-performance computer clusters and will help to perform simulations with much higher spatial and temporal resolution to tackle turbulent flow in technical applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。