arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.09649physics.ins-det
收藏

用于运行3的ALICE的快速熵编码

Fast Entropy Coding for ALICE Run 3

Michael Lettrich

摘要:

在LHC运行3中,升级后的ALICE探测器将以50 kHz的速率连续读出记录Pb-Pb碰撞。产生的3.5 TB/s的原始数据流必须使用一组有损和无损压缩和数据缩减技术处理,以达到90 GB/s的存储数据速率,同时保留相关数据用于物理分析。本文提出了一种基于熵编码的自定义无损数据压缩方案,作为数据缩减链中的最后一个组件,它必须将数据速率从300 GB/s压缩到90 GB/s。一个灵活的,多进程架构的数据压缩方案,提出了无缝接口的数据还原算法的早期阶段,并允许使用并行处理,以保持所需的坚定的实时保证系统。在压缩过程中处理的数据具有允许使用具有更多资源效率的静态分布表的rANS熵编码器的结构。对rANS熵编码器的扩展被引入,以有效地处理这些静态分布表和由每个符号高达25位组成的大型但稀疏的源字母表。初步的性能结果表明,符合公司的实时要求,同时提供接近最佳的数据压缩。

英文摘要:

In LHC Run 3, the upgraded ALICE detector will record Pb-Pb collisions at a rate of 50 kHz usingcontinuous readout. The resulting stream of raw data at 3.5 TB/s has to be processed with a setof lossy and lossless compression and data reduction techniques to a storage data rate of 90 GB/swhile preserving relevant data for physics analysis. This contribution presents a custom losslessdata compression scheme based on entropy coding as the final component in the data reductionchain which has to compress the data rate from 300 GB/s to 90 GB/s. A flexible, multi-processarchitecture for the data compression scheme is proposed that seamlessly interfaces with the datareduction algorithms of earlier stages and allows to use parallel processing in order to keep therequired firm real-time guarantees of the system. The data processed inside the compressionprocess have a structure that allows the use of an rANS entropy coder with more resource efficientstatic distribution tables. Extensions to the rANS entropy coder are introduced to efficientlywork with these static distribution tables and large but sparse source alphabets consisting of upto 25 Bit per symbol. Preliminary performance results show compliance with the firm real-timerequirements while offering close-to-optimal data compression.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑