arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0910.0097physics.ins-detcs.DBcs.DChep-ex
收藏

面向ATLAS分布计算的可扩展数据库访问技术

Scalable Database Access Technologies for ATLAS Distributed Computing

A. Vaniachine

摘要:

ATLAS事件数据处理需要访问非事件数据(探测器条件、校准等)存储在关系数据库中。数据库驻留数据对于事件数据重构处理步骤是至关重要的,并且经常需要用于用户分析。ATLAS数据库操作的一个主要重点是条件DB数据的全球分布,这是每个ATLAS数据处理作业所必需的。由于Conditions DB访问对于使用真实数据的操作至关重要,因此我们开发了一种可以使用不同技术作为冗余备份的系统。冗余的数据库操作基础设施完全满足ATLAS再处理的要求,这已经在网格上的0.5 PB的单光束和宇宙学数据的两次再处理活动期间在10亿次数据库查询的规模上得到了证明。为了收集经验并为最佳技术选择提供投入,成功地评价了在用户分析中有效访问数据库的几个有希望的备选方案。我们目前的ATLAS经验,可扩展的数据库访问技术,并描述我们的方法,防止在网格计算环境中的数据库访问瓶颈。

英文摘要:

ATLAS event data processing requires access to non-event data (detector conditions, calibrations, etc.) stored in relational databases. The database-resident data are crucial for the event data reconstruction processing steps and often required for user analysis. A main focus of ATLAS database operations is on the worldwide distribution of the Conditions DB data, which are necessary for every ATLAS data processing job. Since Conditions DB access is critical for operations with real data, we have developed the system where a different technology can be used as a redundant backup. Redundant database operations infrastructure fully satisfies the requirements of ATLAS reprocessing, which has been proven on a scale of one billion database queries during two reprocessing campaigns of 0.5 PB of single-beam and cosmics data on the Grid. To collect experience and provide input for a best choice of technologies, several promising options for efficient database access in user analysis were evaluated successfully. We present ATLAS experience with scalable database access technologies and describe our approach for prevention of database access bottlenecks in a Grid computing environment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑