arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.14423cs.DCcs.SYeess.SY
收藏

实践中的运营数据分析:从设计到生产环境部署的经验HPC

Operational Data Analytics in Practice: Experiences from Design to Deployment in Production HPC Environments

Alessio Netti, Michael Ott, Carla Guillen, Daniele Tafani, Martin Schulz

摘要:

随着HPC系统复杂性的增长,高效和可管理的操作变得越来越重要。因此,许多中心开始探索使用操作数据分析(ODA)技术,从大量的监测数据中提取知识,并将其用于控制和可视化目的。由于官方发展援助是一个多方面的问题,已作出很大努力研究其各个方面:然而,官方发展援助的生产经验仍然很难找到。在这项工作中,我们的目标是缩小ODA研究和生产使用之间的差距,介绍我们的经验,在生产中的ODA,特别是涉及冷却基础设施的控制和作业数据的可视化两个HPC系统。我们涵盖从设计到部署的整个开发过程,突出我们的见解,努力推动社区向前发展。我们依靠开源工具,这些工具构成了适用于大多数情况的通用官方发展援助框架。

英文摘要:

As HPC systems grow in complexity, efficient and manageable operation is increasingly critical. Many centers are thus starting to explore the use of Operational Data Analytics (ODA) techniques, which extract knowledge from massive amounts of monitoring data and use it for control and visualization purposes. As ODA is a multi-faceted problem, much effort has gone into researching its separate aspects: however, accounts of production ODA experiences are still hard to come across. In this work we aim to bridge the gap between ODA research and production use by presenting our experiences with ODA in production, involving in particular the control of cooling infrastructures and visualization of job data on two HPC systems. We cover the entire development process, from design to deployment, highlighting our insights in an effort to drive the community forward. We rely on open-source tools, which make for a generic ODA framework suitable for most scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑