Through the 1990s, HPC centers at national laboratories, universities, and other large sites designed distributed system architectures and software stacks that enabled extreme-scale computing. By the 2010s, these centers were eclipsed by the scale of web-scale and cloud computing architectures, and today even upcoming exascale HPC systems are magnitudes of scale smaller than those of datacenters employed by large web companies. Meanwhile, the HPC community has allowed system software designs to stagnate, relying on incremental changes to tried-and-true designs to move between generations of systems. We contend that a modern system software stack that focuses on manageability, scalability, security, and modern methods will benefit the entire HPC community. In this paper, we break down the logical parts of a typical HPC system software stack, look at more modern ways to meet their needs, and make recommendations of future work that would help the community move in that direction.
Enabling Hybrid HPCQC Workflows with a Heterogeneous Software Stack
Leibniz Supercomputing Centre (LRZ)(莱布尼茨超级计算中心);IQM Quantum Computers (IQM)(IQM量子计算机公司);Argonne National Laboratory (ANL)(阿贡国家实验室);Munich Quantum Valley (MQV)(慕尼黑量子谷)
HPC Containers for EBRAINS: Towards Portable Cross-Domain Software Environment
Simulation & Data Lab Neuroscience, Jülich Supercomputing Centre, Forschungszentrum Jülich(于利希研究中心);Kirchhoff Institute for Physics, Ruprecht-Karls-Universität(海德堡大学);ATHENA Research & Innovation Center(阿瑞塔研究与创新中心);Computer Engineering, FernUniversität in Hagen(哈根远程大学)
White Paper from Workshop on Large-scale Parallel Numerical Computing Technology (LSPANC 2020): HPC and Computer Arithmetic toward Minimal-Precision Computing
Virtualizing the Stampede2 Supercomputer with Applications to HPC in the Cloud
在得克萨斯州高级计算中心(TACC)开发的方法进行了描述和演示,用于自动化的弹性,虚拟集群模拟冲压2高性能计算(HPC)系统的建设。该集群可以在几分钟内在Jetstream自助云系统上构建和/或扩展,并共享原始Stampede 2的许多属性,包括:i)通用身份管理,ii)访问相同的文件系统,iii)等效的软件应用程序堆栈和模块系统,iv)通过Slurm的类似作业调度界面。我们测量了我们的虚拟集群上的一些常见的科学应用程序的解决方案的时间与Stampede 2上的等效运行,并开发了性能相似或可接受的应用程序配置文件。对于这样的应用程序,虚拟集群提供了一种有效的“云爆发”形式,有可能显著改善总体周转时间,特别是当Stampede 2遇到长队列等待时间时。此外,虚拟集群可用于测试和调试,而不会直接影响Stampede 2。最后,我们讨论了科学网关如何利用TACC Jobs API Web服务来透明地向最终用户集成这种云爆发技术。
Multi-Partner Project: Multi-GPU Performance Portability Analysis for CFD Simulations at Scale
National Technical University of Athens(雅典国立技术大学);KTH Royal Institute of Technology(皇家理工学院);Hewlett Packard Enterprise (HPE)(惠普企业);Technical University of Delft(代尔夫特理工大学);University of Michigan(密歇根大学)
MQSS-Selector: RL-Guided Pass Selection for an MLIR Compilation Pipeline
Leibniz Supercomputing Centre (LRZ)(莱布尼茨超级计算中心);Technical University of Munich (TUM)(慕尼黑工业大学);Munich Quantum Valley (MQV)(慕尼黑量子谷);Argonne National Laboratory (ANL)(阿贡国家实验室)
The SAGE Project: a Storage Centric Approach for Exascale Computing
SAGE(Percipient StorAGe for Exascale Data Centric Computing)是欧盟委员会资助的一个面向Exascale计算时代的项目。它的目标是设计和实现一个具有大数据/极端计算(BDEC)能力的基础设施和相关的软件栈。SAGE系统遵循“以存储为中心”的方法,因为它能够以Exascale方式存储和处理大量数据。SAGE致力于在下一代以数据为中心的计算时代实现大数据分析和HPC的融合。这种融合是由大量数据源的激增所推动的,例如大型分散的科学仪器和传感器,这些数据需要进行处理,分析并集成到模拟中,以获得科学和创新的见解。SAGE系统的第一个原型已经在Julich超级计算中心实施和安装。SAGE存储系统由多层I/O层次结构中的多种存储设备技术组成,包括闪存、磁盘和非易失性存储器技术。主要的SAGE软件组件是Seagate Mero对象存储,可通过Clovis API和更高级别的接口访问。SAGE项目还包括用于验证SAGE概念的科学应用。本文的目的是介绍SAGE项目的概念,SAGE平台的原型,并讨论了SAGE系统的软件体系结构。