自适应并行时间积分与动态资源管理
Adaptive Parallel-in-Time Integration with Dynamic Resource Management
- Technical University of Munich(慕尼黑工业大学)
- Université Grenoble Alpes(格勒诺布尔阿尔卑斯大学)
- Lund University(隆德大学)
机构由 AI 辅助整理,请以论文原文为准。
AI总结:
本研究提出将动态资源管理集成到PFASST并行时间积分方法中,实现计算资源和迭代次数的自适应调整,首次实现实时最优配置识别,提升资源利用率和收敛效率。
AI中文摘要:
随着计算资源的持续增长,空间并行性的强扩展限制促使人们寻求在时间维度上增加并发性,特别是对于具有硬时间约束的应用,如天气和气候模拟。基于谱延迟校正(SDC)的时空并行全近似格式(PFASST)是一种并行时间方法。它通过使用多重网格全近似格式(FAS)校正耦合细网格和粗网格的SDC扫描,同时计算多个时间步。然而,PFASST的收敛性通常依赖于问题,需要在模拟的不同时间使用可变数量的并行时间步,因此需要不同的计算资源。动态资源管理(DRM)通过允许在运行时自适应调整计算资源和算法参数,为这一挑战提供了解决方案。在这项工作中,我们提出了将PFASST与DRM扩展的新方法,该方法能够实现(a)计算资源的动态自适应,(b)基于局部收敛行为自适应选择PFASST迭代次数,以及(c)将这两种自适应耦合为单一调整策略。通过这种方法,我们首次证明可以为每个应用实时识别最优配置,而不是依赖静态分配。此外,我们表明基于收敛信息的PFASST调整提高了资源利用率和收敛效率。
英文摘要:
As computational resources continue to grow, the strong-scaling limitations of spatial parallelism motivate the pursuit of additional concurrency in the temporal dimension, particularly for applications with hard time constraints, such as weather and climate simulations. The Parallel Full Approximation Scheme in Space and Time (PFASST) is a parallel-in-time method based on Spectral Deferred Corrections (SDC). It computes multiple timesteps concurrently by coupling fine- and coarse-grid SDC sweeps using multigrid Full Approximation Scheme (FAS) corrections. However, PFASST's convergence is often problem-dependent, demanding a variable number of parallel timesteps and, hence, computing resources at different times throughout the simulation. Dynamic Resource Management (DRM) provides a remedy for this challenge by enabling the adaptive adjustment of computational resources and algorithmic parameters at runtime. In this work, we present our novel approach to extending PFASST with DRM, which enables (a) dynamic adaptation of computing resources, (b) adaptive selection of the number of PFASST iterations based on local convergence behavior, and (c) coupling of these two adaptations into a single resizing strategy. With this approach, we demonstrate for the first time that optimal configurations can be identified in real time for each application, rather than relying on static allocation. Furthermore, we show that convergence-informed tuning of PFASST improves resource utilization and convergence efficiency.