arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1804.03326cs.DC
收藏

增加ROOT I/O子系统中的并行性

Increasing Parallelism in the ROOT I/O Subsystem

Guilherme Amadio, Brian Bockelman, Philippe Canal, Danilo Piparo, Enric Tejedor, Zhe Zhang

摘要:

在处理大量数据时,读写速率是一个关键因素。基于ROOT的高能物理数据处理也不例外。最近LHC实验软件框架的并行化和对实验收集的不断增加的碰撞数据量的分析进一步强调了这个问题,这需要增加ROOT I/O中表达的隐式并行性。在这方面的贡献,我们强调了改进的ROOT I/O子系统,其目标是在多线程上下文中的一个令人满意的伸缩行为。并行性的影响,这是由根链接到读取和写入数据,即(解)压缩,(反)串行化,访问存储后端的各个步骤,进行了讨论。通过来自传统服务器平台和高度并行架构(如英特尔至强融核)上的CMS生产工作流的实际示例,讨论性能测量。

英文摘要:

When processing large amounts of data, the rate at which reading and writing can take place is a critical factor. High energy physics data processing relying on ROOT is no exception. The recent parallelisation of LHC experiments' software frameworks and the analysis of the ever increasing amount of collision data collected by experiments further emphasized this issue underlying the need of increasing the implicit parallelism expressed within the ROOT I/O. In this contribution we highlight the improvements of the ROOT I/O subsystem which targeted a satisfactory scaling behaviour in a multithreaded context. The effect of parallelism on the individual steps which are chained by ROOT to read and write data, namely (de)compression, (de)serialisation, access to storage backend, are discussed. Performance measurements are discussed through real life examples coming from CMS production workflows on traditional server platforms and highly parallel architectures such as Intel Xeon Phi.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑