RASER：面向HPC集群的弹性智能体调度与执行运行时
RASER: Resilient Agent Scheduling and Execution Runtime for HPC Clusters
浏览论文内容
中文总结 AI 辅助
RASER是扩展Slurm的用户空间框架，通过工作窃取、用户空间检查点等技术，在HPC集群上执行智能体工作流，可缩短近39%执行时间并提升CPU利用率，兼具弹性且部署便捷。
中文摘要 AI 辅助
由大语言模型驱动的现代智能体的出现，催生了在各类需要大量计算资源的领域执行长周期自主工作流的需求。虽然高性能计算（HPC）集群为这些计算密集型工作流提供了理想的基础设施，但传统HPC作业调度器（如Slurm）并非为具有不可预测任务时长、外部API调用以及现代智能体容错需求的动态智能体工作流而设计。本研究提出RASER，这是一个用户空间框架，通过扩展Slurm的内部原语，支持在生产环境HPC集群上无缝执行智能体工作流。RASER引入了基于共享文件系统队列的工作窃取智能体作业数组、通过应用级状态序列化结合Slurm重排队实现的用户空间检查点，以及无需任何镜像修改的基于Apptainer容器的隔离机制。评估结果显示，与静态分区相比，RASER将总执行时间缩短了近39%，同时实现了接近满额的CPU利用率；它具备抵御抢占和故障的弹性，且检查点/恢复开销极小；此外，RASER无需内核特权或外部数据库基础设施，是在现有HPC基础设施上部署智能体工作流的便捷解决方案。
英文摘要
The emergence of modern agents powered by large language models has created a demand for executing long-horizon, autonomous workflows in various domains that require significant computational resources. While High Performance Computing clusters provide the ideal infrastructure for these computation-intensive workloads, traditional HPC job schedulers such as Slurm are not designed for dynamic, agentic workflows characterized by unpredictable task durations, external API calls, and fault tolerance requirements of modern agents. This work presents RASER, a user-space framework that enables seamless execution of agentic workflows on production HPC clusters by extending Slurm's internal primitives. RASER introduces agentic job arrays with work stealing via shared filesystem queues, user-space checkpointing through application-level state serialization combined with Slurm requeue, and Apptainer container-based isolation without requiring any image modifications. Evaluations demonstrate that RASER reduces makespan by nearly 39% compared to static partitioning while achieving near-full CPU utilization. RASER provides resilience against preemption and failures while maintaining minimal checkpoint/restore overhead. It requires no kernel privileges or external database infrastructure, making it an accessible solution for deploying agentic workflows on existing HPC infrastructure.
发表机构
- TUD Dresden University of Technology（德累斯顿工业大学）
机构由 AI 辅助整理，请以论文原文为准。
