CERN虚拟机文件系统的子集：面向超级计算资源的复杂软件栈的快速交付
A Subset of the CERN Virtual Machine File System: Fast Delivering of Complex Software Stacks for Supercomputing Resources
摘要：
在数千个分布式和异构工作节点上提供可复制的环境以及复杂和最新的软件堆栈是一项关键任务。CernVM-文件系统（CVMFS）旨在通过将软件与操作系统分离，帮助各种社区在全球分布式计算基础架构上部署软件。但是，此文件系统的安装取决于与远程资源的系统管理员的协作以及从外部源获取依赖项的HTTP连接。超级计算机提供了巨大的计算能力，通常具有比网格站点更严格的策略，并且不容易提供利用CVMFS的强制条件。为解决这一问题已经制定了不同的解决办法，但这些办法往往是针对某一科学界的，而不是从全球角度来处理这一问题。在本文中，我们提供了一个通用的实用程序，以帮助任何社区在超级计算机上安装复杂的软件依赖关系，而无需外部连接。该方法包括捕获感兴趣的应用程序的依赖关系，构建依赖关系的子集，在给定的环境中对其进行测试，并将其部署到远程计算资源。我们通过在世界顶级超级计算机之一的Mare Nostrum上导出Gauss（LHCb实验的Monte-Carlo模拟程序），用一个真实的用例来实验这个建议。我们提供了封装所需最低文件的步骤，并提供了一个轻量级且易于更新的CVMFS子集：整个LHCb存储库为12.4 TB，而不是5.2 TB。
英文摘要：
Delivering a reproducible environment along with complex and up-to-date software stacks on thousands of distributed and heterogeneous worker nodes is a critical task. The CernVM-File System (CVMFS) has been designed to help various communities to deploy software on worldwide distributed computing infrastructures by decoupling the software from the Operating System. However, the installation of this file system depends on a collaboration with system administrators of the remote resources and an HTTP connectivity to fetch dependencies from external sources. Supercomputers, which offer tremendous computing power, generally have more restrictive policies than grid sites and do not easily provide the mandatory conditions to exploit CVMFS. Different solutions have been developed to tackle the issue, but they are often specific to a scientific community and do not deal with the problem in its globality. In this paper, we provide a generic utility to assist any community in the installation of complex software dependencies on supercomputers with no external connectivity. The approach consists in capturing dependencies of applications of interests, building a subset of dependencies, testing it in a given environment, and deploying it to a remote computing resource. We experiment this proposal with a real use case by exporting Gauss-a Monte-Carlo simulation program from the LHCb experiment-on Mare Nostrum, one of the top supercomputers of the world. We provide steps to encapsulate the minimum required files and deliver a light and easy-to-update subset of CVMFS: 12.4 Gigabytes instead of 5.2 Terabytes for the whole LHCb repository.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
