arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.01791cs.DChep-exphysics.ins-det
收藏

迈向智能数据传输服务

Towards an Intelligent Data Delivery Service

Wen Guan, Tadashi Maeno, Gancho Dimitrov, Brian Paul Bockelman, Torre Wenaus, Vakhtang Tsulaia, Nicolo Magini

摘要:

LHC的ATLAS事件流服务(ESS)是一种为事件服务(ES)预处理和交付数据的方法,它为ATLAS事件处理实现了细粒度的方法。ESS允许只异步传递ES处理所需的输入事件,目的是减少WAN上的数据流量并提高整体数据处理吞吐量。ESS的原型开发提供流事件细粒度ES作业。在此基础上,正在开发智能数据传输服务(iDDS),以解耦数据的“冷格式”和处理格式,这也为包括其他HEP实验的生产系统提供了机会。在这里,我们将首先介绍ESS模型视图和它的动机iDDS系统。然后介绍了iDDS的模式、体系结构和应用。

英文摘要:

The ATLAS Event Streaming Service (ESS) at the LHC is an approach to preprocess and deliver data for Event Service (ES) that has implemented a fine-grained approach for ATLAS event processing. The ESS allows one to asynchronously deliver only the input events required by ES processing, with the aim to decrease data traffic over WAN and improve overall data processing throughput. A prototype of ESS was developed to deliver streaming events to fine-grained ES jobs. Based on it, an intelligent Data Delivery Service (iDDS) is under development to decouple the "cold format" and the processing format of the data, which also opens the opportunity to include the production systems of other HEP experiments. Here we will at first present the ESS model view and its motivations for iDDS system. Then we will also present the iDDS schema, architecture and the applications of iDDS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑