arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1602.00678cs.DC
收藏

Ensemble Toolkit:可扩展且灵活地执行任务集合

Ensemble Toolkit: Scalable and Flexible Execution of Ensembles of Tasks

Vivekanandan Balasubramanian, Antons Treikalis, Ole Weidner, Shantenu Jha

摘要:

有许多科学应用程序需要可扩展的任务级并行性,并支持灵活的执行和耦合的模拟合奏。然而,大多数高性能系统软件和中间件都是设计用于支持单个任务的执行和优化。出于这些计算系统的缺失功能和任务级并行的重要性日益增加,我们介绍了Ensemble工具包,它具有以下应用程序开发功能:(i)抽象,使合奏作为主要实体的表达,以及(ii)支持基于合奏的执行模式,捕获大多数应用程序场景。Ensemble Toolkit使用一个可扩展的基于pilot的运行时系统,该系统将工作负载执行和资源管理细节从应用程序的表达式中分离出来,并使集成在异构计算资源上的高效和动态执行成为可能。我们调查了三种执行模式,并描述了这些模式的可扩展性和开销的Entrance工具包。我们调查的标度性能高达O(1000)并发合奏和O(1000)核心,并找到线性弱和强标度行为。

英文摘要:

There are many science applications that require scalable task-level parallelism and support for flexible execution and coupling of ensembles of simulations. Most high-performance system software and middleware, however, are designed to support the execution and optimization of single tasks. Motivated by the missing capabilities of these computing systems and the increasing importance of task-level parallelism, we introduce the Ensemble toolkit which has the following application development features: (i) abstractions that enable the expression of ensembles as primary entities, and (ii) support for ensemble-based execution patterns that capture the majority of application scenarios. Ensemble toolkit uses a scalable pilot-based runtime system that decouples workload execution and resource management details from the expression of the application, and enables the efficient and dynamic execution of ensembles on heterogeneous computing resources. We investigate three execution patterns and characterize the scalability and overhead of Ensemble toolkit for these patterns. We investigate scaling properties for up to O(1000) concurrent ensembles and O(1000) cores and find linear weak and strong scaling behaviour.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑