LHCb数据集的GRID透明和User-Friendly存储优化
GRID Storage Optimization in Transparent and User-Friendly Way for LHCb Datasets
摘要:
LHCb合作是CERN大型强子对撞机的四个主要实验之一。探测器和蒙特卡罗模拟产生了许多PB的数据。LHCb Grid interware LHCbDIRAC用于向世界各地的所有协作成员提供数据。数据被复制到不同位置的网格站点。然而,网格磁盘存储是有限的,不允许在所有站点保存每个文件的副本。因此,优化副本的数量以实现更好的网格性能是至关重要的。在这项研究中,我们提出了一种新的方法,数据复制和分发策略的基础上,数据流行度预测。基于数据访问历史和元数据执行流行度,并使用机器学习技术和时间序列分析方法。
英文摘要:
The LHCb collaboration is one of the four major experiments at the Large Hadron Collider at CERN. Many petabytes of data are produced by the detectors and Monte-Carlo simulations. The LHCb Grid interware LHCbDIRAC is used to make data available to all collaboration members around the world. The data is replicated to the Grid sites in different locations. However the Grid disk storage is limited and does not allow keeping replicas of each file at all sites. Thus it is essential to optimize number of replicas to achieve a better Grid performance. In this study, we present a new approach of data replication and distribution strategy based on data popularity prediction. The popularity is performed based on the data access history and metadata, and uses machine learning techniques and time series analysis methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。