GEPS中的Grid-Brick事件处理框架
Grid-Brick Event Processing Framework in GEPS
摘要:
像大型强子对撞机上的ATLAS这样的实验涉及的计算和数据管理的规模大大超过了现有系统的能力,因此有必要求助于基于网格的并行事件处理系统(GEPS)。传统的网格系统将数据集中在中央数据服务器上,每次分析或处理作业开始时,都必须由许多节点访问这些服务器。这些系统需要非常强大的中央数据服务器,并且很少使用商用计算机中可用的分布式磁盘空间。本文所描述的网格砖系统遵循不同的方法。数据存储在所有网格节点之间进行分割,每个网格节点都有一条完整的信息。用户提交查询,系统将通过所有节点分发任务并检索结果,然后将它们合并到Job Submit Server中。使用该系统的主要优点是它提供了巨大的可扩展性,而其最大的缺点出现在其中一个节点发生故障的情况下。解决此问题的方法包括数据复制或备份。
英文摘要:
Experiments like ATLAS at LHC involve a scale of computing and data management that greatly exceeds the capability of existing systems, making it necessary to resort to Grid-based Parallel Event Processing Systems (GEPS). Traditional Grid systems concentrate the data in central data servers which have to be accessed by many nodes each time an analysis or processing job starts. These systems require very powerful central data servers and make little use of the distributed disk space that is available in commodity computers. The Grid-Brick system, which is described in this paper, follows a different approach. The data storage is split among all grid nodes having each one a piece of the whole information. Users submit queries and the system will distribute the tasks through all the nodes and retrieve the result, merging them together in the Job Submit Server. The main advantage of using this system is the huge scalability it provides, while its biggest disadvantage appears in the case of failure of one of the nodes. A workaround for this problem involves data replication or backup.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。