发表机构
University of Bristol; Hewlett Packard Enterprise（布里斯托大学; 惠普企业）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
本文在HPE Cray EX超级计算机Isambard-AI上评估Kubernetes部署，针对AI、安全计算等场景设计用例，探讨挑战及Kubernetes作为批处理系统补充的发展方向。
AI 中文摘要
Kubernetes作为容器编排引擎，已在云原生生态系统中广泛应用多年。在超级计算生态系统中，尤其在需考虑计算与网络设备裸金属性能的场景下，其应用相对有限。然而，随着AI、敏感数据的安全与机密计算、混合工作负载编排等用例的日益多样化，传统的单租户批处理计算系统无法提供公共云用户所习惯的灵活性与可复现性。需注意的是，Kubernetes并非批处理调度系统的替代品，后者具备针对拥有数千个网络端点的大规模MPI作业的强大功能；相反，它是国家AI研究资源提供的互补服务。我们在搭载HPE Slingshot互连的Hewlett Packard Enterprise（HPE）Cray EX超级计算机（名为Isambard-AI）上评估Kubernetes部署，并开展协同设计用例研究：其一为面向医药与健康科学的可信研究环境，其二结合KubeRay、Ray与vLLM，提供针对多租户机密计算的分布式、沙箱化、持久化AI模型托管服务。我们探讨了面临的挑战、经验教训，以及在HPE Cray EX（及后续）平台上提供生产级Kubernetes即服务所需的进一步发展方向。
英文摘要
Kubernetes, as a container orchestration engine, has been widely used in cloud-native ecosystems for several years. In supercomputing ecosystems, especially where bare-metal performance for compute and network devices are considered, the adoption is somewhat limited. However, with the increasing diversity of use cases such as AI, secure and confidential computing for sensitive data, and mixed workload orchestration, a traditional, single-tenant batch computing system does not offer the flexibility and reproducibility to which public cloud users are accustomed. Note that Kubernetes is not considered a replacement for batch scheduling systems, which have powerful features for large-scale MPI jobs with thousands of network end points. Rather, it is a complementary service provided as part of a national AI Research Resource. We evaluate Kubernetes deployment on a Hewlett Packard Enterprise (HPE) Cray EX supercomputerwith HPE Slingshot interconnect, called Isambard-AI, with co-design use cases. One is a Trusted Research Environment used for medical and health sciences. The other combines KubeRay, Ray, and vLLM to provide a distributed, sandboxed, persistent AI model hosting service targeting multi-tenant confidential computing. We discuss challenges and lessons learned, and where further development is needed to offer a production Kubernetes-as-a-Service on HPE Cray EX (and later) platforms.
