arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.02872hep-excs.DC
收藏

CMSSW在众核机器上的扩展限制

CMSSW Scaling Limits on Many-Core Machines

Christopher Jones, Patrick Gartung

AI总结:

本研究梳理CMSSW框架的并发模型,在众核机器上用真实CMS应用测试其可扩展性,给出含/不含I/O的吞吐量与内存指标,明确I/O是主要扩展瓶颈。

摘要:

尽管长期来看人们对GPU等计算加速器抱有兴趣,目前大型强子对撞机(LHC)的离线计算仍高度依赖CPU资源。每个CPU插槽的核心数持续稳步增长,最新的AMD EPYC处理器已达到64核(128线程),Ampere Altra Max ARM处理器更是达到128核。在过去十年间,CMS(紧凑缪子线圈)数据处理框架CMSSW已从单线程框架转变为高并发框架。首个多线程版本于2015年LHC Run 2启动时投入生产使用。此后,通过增加更多并发层级、减少串行代码路径的数量,框架的线程效率逐步提升,最新的改进是新增了对并发Run的支持。本研究梳理了CMSSW的并发模型,并在现代众核机器上使用模拟、重建等真实CMS应用测试了其可扩展性。我们给出了包含和不包含I/O影响下的事件处理吞吐量、应用内存占用等指标,因为I/O一直是CMS应用最主要的扩展限制因素。

英文摘要:

Today the LHC offline computing relies heavily on CPU resources, despite the interest in compute accelerators, such as GPUs, for the longer term future. The number of cores per CPU socket has continued to increase steadily, reaching the levels of 64 cores (128 threads) with recent AMD EPYC processors, and 128 cores on Ampere Altra Max ARM processors. Over the course of the past decade, the CMS data processing framework, CMSSW, has been transformed from a single-threaded framework into a highly concurrent one. The first multithreaded version was brought into production by the start of the LHC Run 2 in 2015. Since then, the framework's threading efficiency has gradually been improved by adding more levels of concurrency and reducing the amount of serial code paths. The latest addition was support for concurrent Runs. In this work we review the concurrency model of the CMSSW, and measure its scalability with real CMS applications, such as simulation and reconstruction, on mode rn many-core machines. We show metrics such as event processing throughput and application memory usage with and without the contribution of I/O, as I/O has been the major scaling limitation for the CMS applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑