arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1710.09074cs.DCcs.SE
收藏

一种用于高性能计算弹性的模式语言

A Pattern Language for High-Performance Computing Resilience

Saurabh Hukerikar, Christian Engelmann

摘要:

高性能计算系统(HPC)为广泛的计算问题提供了强大的建模、仿真和数据分析功能。它们通过聚合数百万个计算、内存、网络和存储组件的能力,实现每秒四进制浮点算术计算数量级的极端性能。随着HPC系统的规模和复杂性迅速增长,以实现更高的性能,确保其在系统降级和故障面前的可靠运行是一个关键的挑战。系统故障事件经常导致科学应用产生错误的结果,甚至可能导致其过早终止。现代极端规模HPC系统中的组件数量庞大,硬件和软件组件、应用程序和物理环境之间的交互和依赖关系复杂,这使得设计支持故障恢复的实用解决方案成为一项复杂的任务。为了管理这种复杂性,我们开发了一种使用设计模式设计HPC弹性解决方案的方法。我们将过去三十年来设计、应用和改进的用于处理故障、错误和失败的著名技术以设计模式的形式进行了整理。在本文中,我们提出了一种模式语言,使结构化的方法来开发HPC弹性解决方案。模式语言揭示了弹性模式之间的关系,并提供了一种手段,探索替代技术处理特定的故障模型,可能有不同的效率和复杂性的特点。使用模式语言可以将全面的弹性解决方案设计和实现为一组相互关联的弹性模式,这些模式可以跨系统堆栈的各个层进行实例化。

英文摘要:

High-performance computing systems (HPC) provide powerful capabilities for modeling, simulation, and data analytics for a broad class of computational problems. They enable extreme performance of the order of quadrillion floating-point arithmetic calculations per second by aggregating the power of millions of compute, memory, networking and storage components. With the rapidly growing scale and complexity of HPC systems for achieving even greater performance, ensuring their reliable operation in the face of system degradations and failures is a critical challenge. System fault events often lead the scientific applications to produce incorrect results, or may even cause their untimely termination. The sheer number of components in modern extreme-scale HPC systems and the complex interactions and dependencies among the hardware and software components, the applications, and the physical environment makes the design of practical solutions that support fault resilience a complex undertaking. To manage this complexity, we developed a methodology for designing HPC resilience solutions using design patterns. We codified the well-known techniques for handling faults, errors and failures that have been devised, applied and improved upon over the past three decades in the form of design patterns. In this paper, we present a pattern language to enable a structured approach to the development of HPC resilience solutions. The pattern language reveals the relations among the resilience patterns and provides the means to explore alternative techniques for handling a specific fault model that may have different efficiency and complexity characteristics. Using the pattern language enables the design and implementation of comprehensive resilience solutions as a set of interconnected resilience patterns that can be instantiated across layers of the system stack.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑