McRunjob:一个用于电网生产过程的高能物理工作流规划器
McRunjob: A High Energy Physics Workflow Planner for Grid Production Processing
摘要:
McRunjob是一个强大的网格工作流管理器,用于管理高能物理中大量生产处理作业的生成。自1999年以来,McRunjob一直用于管理大型Monte Carlo生产过程,并正在扩展到常规生产过程中的分析和重建。在CHEP 2001中描述,McRunjob将核心元数据转换为可在各种环境中提交的作业。强大的核心元数据描述语言包括将元数据转换为持久形式、工作描述、多步骤工作流和数据起源信息的方法。该语言的功能允许在元数据中的结构,包括完整的表达式,命名空间,功能依赖,在网格环境中的站点特定的参数,和本体定义。它还具有简单的控制结构,用于大型作业的并行化。McRunjob采用了模块化设计,可以轻松扩展到新的工作描述语言或新的应用级任务。
英文摘要:
McRunjob is a powerful grid workflow manager used to manage the generation of large numbers of production processing jobs in High Energy Physics. In use at both the DZero and CMS experiments, McRunjob has been used to manage large Monte Carlo production processing since 1999 and is being extended to uses in regular production processing for analysis and reconstruction. Described at CHEP 2001, McRunjob converts core metadata into jobs submittable in a variety of environments. The powerful core metadata description language includes methods for converting the metadata into persistent forms, job descriptions, multi-step workflows, and data provenance information. The language features allow for structure in the metadata by including full expressions, namespaces, functional dependencies, site specific parameters in a grid environment, and ontological definitions. It also has simple control structures for parallelization of large jobs. McRunjob features a modular design which allows for easy expansion to new job description languages or new application level tasks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。