使用gLite DPM优化对用户分析数据的访问
Optimised access to user analysis data using the gLite DPM
摘要:
ScotGrid分布式Tier-2现在为LHC计算提供超过4 MSI 2K和500 TB的数据,分布在达勒姆、爱丁堡和格拉斯哥的三个站点。第二层站点在LHC VO的计算模型中扮演着双重角色。首先,它们的CPU资源用于生成Monte Carlo事件数据。其次,最终用户的分析数据通过网格分布到站点的存储系统,并保存在磁盘上,以供物理学家的分析作业进行处理。在本文中,我们将展示我们如何设计的ScotGrid存储和数据管理资源,以优化物理学家访问大型强子对撞机数据。在ScotGrid中,所有站点都使用gLite存储管理器中间件。使用EGEE网格提交真正的ATLAS分析代码来处理存储在ScotGrid网站上的VO数据,我们提出了一个分析的架构在一个网站上的性能,和程序,可以进行改进。结果将从最终用户的角度(以每秒处理的事件数量为单位)和现场的角度呈现,现场希望最大限度地减少负载和分析活动对系统其他用户的影响。
英文摘要:
The ScotGrid distributed Tier-2 now provides more that 4MSI2K and 500TB for LHC computing, which is spread across three sites at Durham, Edinburgh and Glasgow. Tier-2 sites have a dual role to play in the computing models of the LHC VOs. Firstly, their CPU resources are used for the generation of Monte Carlo event data. Secondly, the end user analysis data is distributed across the grid to the site's storage system and held on disk ready for processing by physicists' analysis jobs. In this paper we show how we have designed the ScotGrid storage and data management resources in order to optimise access by physicists to LHC data. Within ScotGrid, all sites use the gLite DPM storage manager middleware. Using the EGEE grid to submit real ATLAS analysis code to process VO data stored on the ScotGrid sites, we present an analysis of the performance of the architecture at one site, and procedures that may be undertaken to improve such. The results will be presented from the point of view of the end user (in terms of number of events processed/second) and from the point of view of the site, which wishes to minimise load and the impact that analysis activity has on other users of the system.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。