ROSA: 面向机器人工厂的基础模型服务系统
ROSA: A Robotics Foundation Model Serving System for Robot Factories
AI总结:
提出ROSA系统,通过共享GPU池服务、多模型流水线支持和工厂目标驱动调度,将机器人工厂的RFM推理性能提升12倍以上。
摘要:
机器人基础模型(RFM)正使通用机器人在工厂部署中日益实用。虽然RFM服务系统是实现这一愿景的核心,但现有系统主要受单机器人、单模型假设的制约:推理被视为由机器人上或专用近端GPU处理的边缘计算问题,服务目标是最小化单个动作模型的延迟。本文提出ROSA,一个面向机器人工厂的RFM服务系统,围绕三个关键原则设计。首先,ROSA采用共享GPU池服务,允许机器人车队通过网络访问强大的服务器级GPU,以提高推理性能、电池续航和GPU利用率。其次,ROSA提供机器人感知的编程抽象和系统设计,支持多模型流水线、按任务性能要求和故障处理。第三,ROSA使用工厂目标驱动调度,最大化符合SLO的工厂生产力,而非最小化单个请求延迟。我们在Ray Serve上实现ROSA以进行分布式编排,并使用vLLM、PyTorch和JAX作为模型服务后端,在真实机器人和合成大规模工作负载上评估。结果表明,与传统专用服务系统相比,ROSA将工厂生产力提升高达12.06倍。
英文摘要:
Robotics foundation models (RFMs) are making general-purpose robots increasingly practical for factory deployments. While RFM serving systems are central to this vision, existing systems are largely shaped by a single-robot, single-model assumption: inference is treated as an edge-computing problem handled by an on-robot or dedicated nearby GPU, and the serving objective is to minimize the latency of a single action model. In this paper, we propose ROSA, an RFM serving system for robot factories designed around three key principles. First, ROSA adopts shared GPU-pool serving, allowing a fleet of robots to access powerful server-class GPUs over the network in order to improve inference performance, battery duration, and GPU utilization. Second, ROSA provides a robotics-aware programming abstraction and system design that supports multi-model pipelines, per-task performance requirements, and failure handling. Third, ROSA uses factory-objective-driven scheduling to maximize SLO-qualified factory productivity rather than minimizing individual request latency. We implement ROSA on top of Ray Serve for distributed orchestration, with vLLM, PyTorch, and JAX as model-serving backends, and evaluate it on both real robots and synthetic large-scale workloads. The results show that ROSA improves factory productivity by up to 12.06x over conventional dedicated serving systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。