使用Python进行天气和气候建模的高效性能工程
Productive Performance Engineering for Weather and Climate Modeling with Python
摘要:
地球系统模型的开发与目标硬件紧密耦合,通常包含基于处理器特性的专用代码。这种耦合源于使用命令式语言来硬编码计算调度和布局。我们提出了一个详细的帐户优化有限体积立方体球动态核心(FV3),提高生产力和性能。通过使用声明式Python嵌入式模板特定于域的语言和以数据为中心的优化,我们抽象出特定于硬件的细节,并定义了一个半自动化的工作流程,用于分析和优化天气和气候应用程序。工作流程利用本地和全程序优化,以及用户指导的微调。为了修剪不可行的全局优化空间,我们自动利用重复的代码图案通过一种新的转移调整方法。在Piz Daint超级计算机上,我们可以扩展到2,400个GPU,以原始代码的一小部分实现了高达3.92倍的优化生产实现加速。
英文摘要:
Earth system models are developed with a tight coupling to target hardware, often containing specialized code predicated on processor characteristics. This coupling stems from using imperative languages that hard-code computation schedules and layout. We present a detailed account of optimizing the Finite Volume Cubed-Sphere Dynamical Core (FV3), improving productivity and performance. By using a declarative Python-embedded stencil domain-specific language and data-centric optimization, we abstract hardware-specific details and define a semi-automated workflow for analyzing and optimizing weather and climate applications. The workflow utilizes both local and full-program optimization, as well as user-guided fine-tuning. To prune the infeasible global optimization space, we automatically utilize repeating code motifs via a novel transfer tuning approach. On the Piz Daint supercomputer, we scale to 2,400 GPUs, achieving speedups of up to 3.92x over the tuned production implementation at a fraction of the original code.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。