arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.07885hep-exphysics.comp-ph
收藏

高性能计算时代的HEP实验数据存储

Data Storage for HEP Experiments in the Era of High-Performance Computing

Amit Bashyal, Peter Van Gemmeren, Saba Sehrish, Kyle Knoepfel, Suren Byna, Qiao Kang

摘要:

随着粒子物理实验在能量和强度边界上突破极限,预计产生的数据的数量和复杂性也将相应增加。有了如此大的数据量,像HL-LHC和DUNE这样的下一代工作将更加依赖于高吞吐量(HTC)和高性能(HPC)计算集群。充分利用HPC资源需要可扩展且高效的数据处理和I/O。在过去的几十年里,ROOT已经被大多数HEP实验用来存储数据。但是,其他存储技术(如HDF 5)可能在HPC环境中表现更好。HDF 5的初步探索已经开始使用ATLAS,CMS和DUNE数据; DUNE实验也采用HDF 5作为其数据采集系统。本文介绍了HEP计算的未来前景和HPC的作用,并总结了正在进行的和未来的工作,使用HDF 5作为一种可能的数据存储技术的HEP实验中使用的HPC环境。

英文摘要:

As particle physics experiments push their limits on both the energy and the intensity frontiers, the amount and complexity of the produced data are also expected to increase accordingly. With such large data volumes, next-generation efforts like the HL-LHC and DUNE will rely even more on both high-throughput (HTC) and high-performance (HPC) computing clusters. Full utilization of HPC resources requires scalable and efficient data-handling and I/O. For the last few decades, ROOT has been used by most HEP experiments to store data. However, other storage technologies like HDF5 may perform better in HPC environments. Initial explorations with HDF5 have begun using ATLAS, CMS and DUNE data; the DUNE experiment has also adopted HDF5 for its data-acquisition system. This paper presents the future outlook of the HEP computing and the role of HPC, and a summary of ongoing and future works to use HDF5 as a possible data storage technology for the HEP experiments to use in HPC environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑