arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0612137cs.DB
收藏

将集群管理转变为数据管理:系统概述

Turning Cluster Management into Data Management: A System Overview

Eric Robinson, David DeWitt

摘要:

本文介绍了CondorJ 2集群管理系统。传统上,集群管理系统(如Condor)采用面向过程的方法,很少或根本没有使用现代数据库系统技术。相比之下,CondorJ 2为所有系统功能(例如,作业提交、监控和调度;节点配置、监控和管理等)除了作业执行。采用面向数据的方法可以解决核心挑战(即,管理和协调大量的分布式计算资源),以便从相对低级的系统问题转换成更抽象、更高级的数据管理问题。初步结果表明,CondorJ 2对标准3层软件的使用代表了大型集群(1,000到10,000个节点)设计和实现的重要一步。

英文摘要:

This paper introduces the CondorJ2 cluster management system. Traditionally, cluster management systems such as Condor employ a process-oriented approach with little or no use of modern database system technology. In contrast, CondorJ2 employs a data-centric, 3-tier web-application architecture for all system functions (e.g., job submission, monitoring and scheduling; node configuration, monitoring and management, etc.) except for job execution. Employing a data-oriented approach allows the core challenge (i.e., managing and coordinating a large set of distributed computing resources) to be transformed from a relatively low-level systems problem into a more abstract, higher-level data management problem. Preliminary results suggest that CondorJ2's use of standard 3-tier software represents a significant step forward to the design and implementation of large clusters (1,000 to 10,000 nodes).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑