arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1804.09798cs.DC
收藏

并行机任务映射的几何划分与排序策略

Geometric Partitioning and Ordering Strategies for Task Mapping on Parallel Computers

Mehmet Deveci, Karen D. Devine, Kevin Pedretti, Mark A. Taylor, Sivasankaran Rajamanickam, Umit V. Catalyurek

摘要:

提出了一种将应用程序的MPI任务映射到并行计算机核上的新方法,从而减少了应用程序的通信时间。我们解决稀疏节点分配的情况下,分配给一个工作的节点不一定位于一个连续的块,也不一定在网络中彼此接近,虽然我们的方法推广到连续的分配以及。目标是将任务分配给核心,以便由“附近”的核心执行相互依赖的任务,从而降低消息必须传输的距离,网络中的拥塞量以及通信的总体成本。我们的新方法适用于几何划分算法的任务和处理器,并分配任务部分相应的处理器部分。我们还提出了一些算法优化,利用网络或应用程序的特定功能。我们发现,对于结构化有限差分迷你应用程序MiniGhost,我们的映射方法减少了通信时间高达75%相对于MiniGhost的默认映射128 K核心的Cray XK 7稀疏分配。对于大气建模代码E3 SM/HOMME,我们的方法减少了31%的IBM BlueGene/Q连续分配的32 K核心的通信时间。

英文摘要:

We present a new method for mapping applications' MPI tasks to cores of a parallel computer such that applications' communication time is reduced. We address the case of sparse node allocation, where the nodes assigned to a job are not necessarily located in a contiguous block nor within close proximity to each other in the network, although our methods generalize to contiguous allocations as well. The goal is to assign tasks to cores so that interdependent tasks are performed by "nearby" cores, thus lowering the distance messages must travel, the amount of congestion in the network, and the overall cost of communication. Our new method applies a geometric partitioning algorithm to both the tasks and the processors, and assigns task parts to the corresponding processor parts. We also present a number of algorithmic optimizations that exploit specific features of the network or application. We show that, for the structured finite difference mini-application MiniGhost, our mapping methods reduced communication time up to 75% relative to MiniGhost's default mapping on 128K cores of a Cray XK7 with sparse allocation. For the atmospheric modeling code E3SM/HOMME, our methods reduced communication time up to 31% on 32K cores of an IBM BlueGene/Q with contiguous allocation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑