arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.09645cs.DChep-ex
收藏

用消息队列寻址Scalability:DIRAC接口的体系结构和用例

Addressing Scalability with Message Queues: Architecture and Use Cases for DIRAC Interware

Wojciech Krzemien, Federico Stagni, Christophe Haen, Zoltan Mathe, Andrew McNab, Milosz Zdybal

摘要:

消息队列(MQ)体系结构是一种异步通信方案,它为分布式计算模型中的某些场景提供了有吸引力的解决方案。MQ作为交互过程之间的中间组件的引入允许对端点进行解耦,从而使系统更加灵活,并提供高可伸缩性和冗余。DIRAC是一个用于分布式计算系统的通用中间件软件,它为许多异构提供者提供了一个公共接口,并保证了资源的透明和可靠使用。DIRAC平台已被多个科学项目采用,包括LHCb、线性对撞机和Belle 2等高能物理社区。消息队列通用接口已被纳入DIRAC框架,以帮助解决从2021年开始的LHC Run3期间必须解决的可扩展性挑战。它允许使用MQ方案在DIRAC组件之间进行消息交换或与第三方服务进行通信。在这篇文章中,我们描述了MQ系统与DIRAC的集成,并展示了几个用例。信息记录器预计将用于先导记录系统,并作为DIRAC组件记录系统和监控的骨干。

英文摘要:

The Message Queue (MQ) architecture is an asynchronous communication scheme that provides an attractive solution for certain scenarios in a distributed computing model. The introduction of MQ as an intermediate component in-between the interacting processes allows to decouple the end-points making the system more flexible and providing high scalability and redundancy. DIRAC is a general-purpose interware software for distributed computing systems, which offers a common interface to a number of heterogeneous providers and guarantees transparent and reliable usage of the resources. The DIRAC platform has been adapted by several scientific projects, including High Energy Physics communities like LHCb, the Linear Collider and Belle2. A Message Queue generic interface has been incorporated into the DIRAC framework to help solving the scalability challenges that must be addressed during LHC Run3, starting in 2021. It allows to use the MQ scheme for a message exchange among the DIRAC components or to communicate with third-party services. Within this contribution we describe the integration of MQ systems with DIRAC and several use cases are shown. Message Queues are foreseen to be used in the pilot logging system, and as a backbone of the DIRAC component logging system and monitoring.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑