arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0306068cs.DC
收藏

AliEn资源经纪人

AliEn Resource Brokers

Pablo Saiz, Predrag Buncic, Andreas J. Peters

摘要:

AliEn(ALICE Environment)是Alice Collaboration开发的一个轻量级网格框架。当实验开始运行时,它将以每年大约2 PB的速度收集数据,每年产生O(109)个文件。所有这些文件,包括实验准备阶段产生的所有模拟事件,都必须在全球资源数据库环境中加以说明和可靠跟踪。AliEn的主干是一个分布式文件目录,它将通用逻辑文件名与每个数据集的物理文件名相关联,并提供独立于物理位置的数据集透明访问。文件复制和传输是在文件传输代理的控制下进行的。此外,文件目录还维护系统中运行的每个作业的信息。作业由作业资源代理分发,作业资源代理使用简化的拉式(与传统的推式相反)架构实现。本文介绍了作业和文件传输资源代理,并表明,一个类似的体系结构可以应用于解决这两个问题。

英文摘要:

AliEn (ALICE Environment) is a lightweight GRID framework developed by the Alice Collaboration. When the experiment starts running, it will collect data at a rate of approximately 2 PB per year, producing O(109) files per year. All these files, including all simulated events generated during the preparation phase of the experiment, must be accounted and reliably tracked in the GRID environment. The backbone of AliEn is a distributed file catalogue, which associates universal logical file name to physical file names for each dataset and provides transparent access to datasets independently of physical location. The file replication and transport is carried out under the control of the File Transport Broker. In addition, the file catalogue maintains information about every job running in the system. The jobs are distributed by the Job Resource Broker that is implemented using a simplified pull (as opposed to traditional push) architecture. This paper describes the Job and File Transport Resource Brokers and shows that a similar architecture can be applied to solve both problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑