LHC Run 3及以后CMS提交基础设施中异构资源的集成
The integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyond
AI总结:
针对LHC Run 3及以后异构计算资源(如ARM、Power和GPU)的集成需求,本文介绍了CMS提交基础设施的更新能力,以支持高效资源利用,并报告了全面集成异构资源的下一步计划。
摘要:
虽然当前支持LHC实验的计算格局主要由WLCG站点的x86处理器主导,但这种配置将在未来几年内发生变化。LHC合作组织将越来越多地采用HPC和云设施来处理LHC Run 3及未来HL-LHC阶段预期的大量数据。这些设施通常具有多样化的计算资源,包括ARM和IBM Power等替代CPU架构,以及各种GPU规格。因此,有效利用这些异构资源对于LHC合作组织实现其未来的科学目标至关重要。提交基础设施(SI)是CMS计算中的核心要素,能够实现CMS数据处理、模拟和分析任务对资源的获取和利用。因此,必须调整SI以确保对这些异构计算能力的访问和最优利用。这一演进的一些步骤已经采取,因为CMS目前正在机会性地使用主要由CMS WLCG站点提供的一小部分GPU槽位。此外,Power9处理器已在CINECA的Marconi-100集群上验证用于CMS生产。本文将描述SI的更新能力,以继续确保CMS对计算资源的有效分配和使用,尽管资源日益多样化。还将报告根据CMS需求全面集成和支持异构资源的下一步措施。
英文摘要:
While the computing landscape supporting LHC experiments is currently dominated by x86 processors at WLCG sites, this configuration will evolve in the coming years. LHC collaborations will be increasingly employing HPC and Cloud facilities to process the vast amounts of data expected during the LHC Run 3 and the future HL-LHC phase. These facilities often feature diverse compute resources, including alternative CPU architectures like ARM and IBM Power, as well as a variety of GPU specifications. Using these heterogeneous resources efficiently is thus essential for the LHC collaborations reaching their future scientific goals. The Submission Infrastructure (SI) is a central element in CMS Computing, enabling resource acquisition and exploitation by CMS data processing, simulation and analysis tasks. The SI must therefore be adapted to ensure access and optimal utilization of this heterogeneous compute capacity. Some steps in this evolution have been already taken, as CMS is currently using opportunistically a small pool of GPU slots provided mainly at the CMS WLCG sites. Additionally, Power9 processors have been validated for CMS production at the Marconi-100 cluster at CINECA. This note will describe the updated capabilities of the SI to continue ensuring the efficient allocation and use of computing resources by CMS, despite their increasing diversity. The next steps towards a full integration and support of heterogeneous resources according to CMS needs will also be reported.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。