arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.12752cs.DC
收藏

WRATH:基于任务的并行编程框架中跨任务层级的工作负载韧性

WRATH: Workload Resilience Across Task Hierarchies in Task-based Parallel Programming Frameworks

Sicheng Zhou, Zhuozhao Li, Valérie Hayot-Sasson, Haochen Pan, Maxime Gonthier, J. Gregory Pauloski, Ryan Chard, Kyle Chard, Ian Foster

AI总结:

WRATH提出基于TBPP框架分层结构的故障分类与响应机制,结合分布式监控和弹性模块,显著提升任务成功率至三倍,应用成功率超90%,并缩短故障时间20%-50%。

摘要:

基于任务的并行编程(TBPP)中的故障会严重降低性能,并导致结果不完整或不正确。现有的故障处理方法,包括反应式、主动式和弹性方法(如重试和检查点机制),通常无论故障的根本原因如何,都采用统一的重试机制,未能考虑到TBPP框架的独特特性,如异构资源可用性和任务级故障。为解决这些局限性,我们提出了WRATH,一种新颖的系统性方法,该方法基于TBPP框架的独特分层结构对故障进行分类,并定义针对不同层故障的具体响应。WRATH结合了分布式监控系统和弹性模块,以实时协同处理不同类型的故障。监控系统捕获执行和资源信息,报告故障,并在TBPP框架的不同层对任务进行剖析。弹性模块随后对故障进行分类,并采取适当的行动,如在合适的资源上分层重试失败的任务。评估表明,WRATH显著提高了TBPP的韧性,使任务成功率提高了两倍,并针对可解决的故障维持了超过90%的应用成功率。此外,WRATH可以将故障发生时间减少20%-50%,使得注定失败的任务能够被识别并更快地失败。

英文摘要:

Failures in Task-based Parallel Programming (TBPP) can severely degrade performance and result in incomplete or incorrect outcomes. Existing failure-handling approaches, including reactive, proactive, and resilient methods such as retry and checkpointing mechanisms, often apply uniform retry mechanisms regardless of the root cause of failures, failing to account for the unique characteristics of TBPP frameworks such as heterogeneous resource availability and task-level failures. To address these limitations, we propose WRATH, a novel systematic approach that categorizes failures based on the unique layered structure of TBPP frameworks and defines specific responses to address failures at different layers. WRATH combines a distributed monitoring system and a resilient module to collaboratively address different types of failures in real time. The monitoring system captures execution and resource information, reports failures, and profiles tasks across different layers of TBPP frameworks. The resilient module then categorizes failures and responds with appropriate actions, such as hierarchically retrying failed tasks on suitable resources. Evaluations demonstrate that WRATH significantly improves TBPP robustness, tripling the task success rate and maintaining an application success rate of over 90% for resolvable failures. Additionally, WRATH can reduce the time to failure by 20%-50%, allowing tasks that are destined to fail to be identified and fail more quickly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑