在HPX中实现软件弹性以支持极端规模计算
Implementing Software Resiliency in HPX for Extreme Scale Computing
摘要:
由于硬件故障而在任务关键型应用程序中发生的故障和错误具有很高的成本。随着下一代平台(NGP)的出现,硬件故障率将不可避免地增加。因此,将我们的应用程序设计为具有弹性是一个关键问题,以便在满足功率预算限制的同时保持结果的可靠性。在本文中,我们实现了软件弹性在HPX,异步多任务并行处理系统。我们实现了两个向应用程序开发人员公开的弹性API,即任务复制和任务重播。任务复制将任务重复n次并异步执行它们。任务重播将重新调度任务多达n次,直到返回有效的输出。此外,我们还引入了一个API,允许应用程序使用用户提供的谓词验证返回的结果。我们测试的API与人工工作负载和一个基于模板的应用程序。我们证明,只有轻微的开销时,利用这些弹性功能的工作负载的任务大小大于200 $μ$ s。我们还表明,大部分增加的执行时间来自任务本身的重放或复制,而不是由API的实现。
英文摘要:
Exceptions and errors occurring within mission critical applications due to hardware failures have a high cost. With the emerging Next Generation Platforms (NGPs), the rate of hardware failures will invariably increase. Therefore, designing our applications to be resilient is a critical concern in order to retain the reliability of results while meeting the constraints on power budgets. In this paper, we implement software resilience in HPX, an Asynchronous Many-Task Runtime system. We implement two resiliency APIs that we expose to the application developers, namely task replication and task replay. Task replication repeats a task n-times and executes them asynchronously. Task replay will reschedule a task up to n-times until a valid output is returned. Furthermore, we introduce an API that allows the application to verify the returned result with a user provided predicate. We test the APIs with both artificial workloads and a dataflow based stencil application. We demonstrate that only minor overheads are incurred when utilizing these resiliency features for work loads where the task size is greater than 200 $μ$s. We also show that most of the added execution time arises from the replay or replication of the tasks themselves and not by the implementation of the APIs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。