仿真工厂:在高端的资源上驯服应用配置和工作流
Simulation Factory: Taming Application Configuration and Workflow on High-End Resources
摘要:
大型高性能计算资源上的计算科学受到这些系统的复杂性的阻碍。这种复杂性的大部分是由于这些资源的低级别细节暴露给应用程序和最终用户。这包括(但不限于)远程访问机制,从源代码配置和构建应用程序,以及通过批处理队列系统管理模拟及其输出文件。这些挑战在现代研究环境中成倍增加,其中研究合作跨越多个团体,通常是在松散定义的国际合作中,其中不断有新学生涌入多年项目,并且在几个不同的资源上进行模拟。Simulation Factory通过显著简化远程访问、构建可执行文件和管理模拟来解决这些挑战。通过抽象出不同资源之间的底层差异,它为这些资源提供了一个统一的接口。与此同时,它可以强制执行某些标准来执行模拟,这些模拟封装了经验丰富的用户的最佳实践。此外,SimFactory的自动化避免了许多可能的用户错误,这些错误在最坏的情况下会使长达一个月的模拟变得毫无价值。
英文摘要:
Computational Science on large high performance computing resources is hampered by the complexity of these systems. Much of this complexity is due to low-level details on these resources that are exposed to the application and the end user. This includes (but is not limited to) mechanisms for remote access, configuring and building applications from source code, and managing simulations and their output files via batch queue systems. These challenges multiply in a modern research environment, where a research collaboration spans multiple groups, often in loosely defined international collaborations, where there is a constant influx of new students into multi-year projects, and where simulations are performed on several different resources. The Simulation Factory addresses these challenges by significantly simplifying remote access, building executables, and managing simulations. By abstracting out the low-level differences between different resources, it offers a uniform interface to these resources. At the same time, it can enforce certain standards for performing simulations that encapsulate best practices from experienced users. Furthermore, SimFactory's automation avoids many possible user errors that can in the worst case render month-long simulations worthless.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。