arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1708.07422cs.DCcs.SE
收藏

弹性设计模式:极端规模弹性的结构化方法

Resilience Design Patterns: A Structured Approach to Resilience at Extreme Scale

Saurabh Hukerikar, Christian Engelmann

摘要:

可靠性是未来超大规模高性能计算(HPC)系统的一个严重问题。虽然HPC社区已经开发了各种弹性解决方案,但解决方案空间仍然分散。没有正式的方法和指标将各种HPC弹性技术集成到复合解决方案中,也没有方法从保护范围以及性能和能效特性方面全面评估此类解决方案的充分性和有效性。在本文中,我们开发了一个结构化的方法来设计,评估和优化的HPC弹性使用的设计模式的概念。设计模式是针对常见问题的通用可重复解决方案。我们确定的各种类型的故障,错误和HPC系统中的故障和用于处理这些事件的技术所造成的问题。每个解决特定HPC弹性挑战的众所周知的解决方案都以模式的形式描述。我们开发了一个完整的目录,这种弹性设计模式,可用作设计和部署弹性解决方案时的基本构建块。我们还开发了一个设计框架,提高了设计师的理解的机会,集成多个模式跨层的系统堆栈和重要的限制,在实施过程中的个人模式。它还可用于定义机制和接口,以协调跨硬件和软件组件的灵活故障管理。这项工作的总体目标是建立一种系统化的方法,用于设计和评估极端规模HPC系统中的弹性技术,以及时和经济高效的方式保持科学应用程序运行到正确的解决方案,尽管频繁的故障,错误和各种类型的故障。

英文摘要:

Reliability is a serious concern for future extreme-scale high-performance computing (HPC) systems. While the HPC community has developed various resilience solutions, the solution space remains fragmented. There are no formal methods and metrics to integrate the various HPC resilience techniques into composite solutions, nor are there methods to holistically evaluate the adequacy and efficacy of such solutions in terms of their protection coverage, and their performance & power efficiency characteristics. In this paper, we develop a structured approach to the design, evaluation and optimization of HPC resilience using the concept of design patterns. A design pattern is a general repeatable solution to a commonly occurring problem. We identify the problems caused by various types of faults, errors and failures in HPC systems and the techniques used to deal with these events. Each well-known solution that addresses a specific HPC resilience challenge is described in the form of a pattern. We develop a complete catalog of such resilience design patterns, which may be used as essential building blocks when designing and deploying resilience solutions. We also develop a design framework that enhances a designer's understanding the opportunities for integrating multiple patterns across layers of the system stack and the important constraints during implementation of the individual patterns. It is also useful for defining mechanisms and interfaces to coordinate flexible fault management across hardware and software components. The overall goal of this work is to establish a systematic methodology for the design and evaluation of resilience technologies in extreme-scale HPC systems that keep scientific applications running to a correct solution in a timely and cost-efficient manner despite frequent faults, errors, and failures of various types.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑