arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2610.37378cs.RO
收藏

VLA-Stem:基于强化学习的轻量级视觉-语言-动作模型安全机制

VLA-Stem: A Lightweight Safety Mechanism for Vision-Language-Action Models via Reinforcement Learning

University of Science and Technology of China (USTC)(中国科学技术大学);University of Macau (UM)(澳门大学);Peking University (PKU)(北京大学)

Bojun Zou, Wenhao Yu, Jiaohao Li, Jiaxuan Lin, Guanting Ye, Haohan Geng, Weihao Yu, Yanyong Zhang, Jianmin Ji

AI总结:

本研究提出VLA-Stem这一轻量级安全机制,结合强化学习等方法,在不微调底层VLA策略的情况下,显著提升机器人避障性能,同时保留原任务能力。

摘要:

视觉-语言-动作(VLA)模型将高层推理与低层动作执行相结合,用于端到端机器人控制。然而,大多数VLA模型针对无约束环境中的静态操作,忽略了空间约束与动态障碍物。在避障数据上微调VLA是直接的解决方案,但收集此类数据成本高昂,尤其针对动态场景,且可能降低其原始任务能力。为解决这些局限,我们提出VLA-Stem,一种用于VLA系统的轻量级、基于强化学习的安全机制。无需微调底层VLA策略,VLA-Stem将其动作块转换为运动参考,并利用轨迹级引导保留其空间意图,同时允许灵活的运动与时间调整。基于这些参考、机器人本体感觉及局部障碍物信息,Stem策略在推理时自适应修改执行,在保留原始任务意图的同时,实现对空间约束与动态障碍物的响应式适应。为实现鲁棒且样本高效的训练,我们结合教师-学生蒸馏与课程学习。我们在参考跟踪、静态空间约束及动态避障场景下评估VLA-Stem。在6种受限仿真设置中,VLA-Stem的平均无碰撞任务成功率达52.8%,而最强安全基线仅为23.7%,同时在无障碍物设置中保留基础策略性能;真实世界实验进一步显示,其在静态与动态障碍物下实现持续碰撞减少。这些结果表明,VLA-Stem将高层VLA任务意图与对即时物理风险的快速反射式响应相结合,为机器人鲁棒执行提供了一种脑干启发的机制。

英文摘要:

Vision-Language-Action (VLA) models integrate high-level reasoning with low-level action execution for end-to-end robotic control. However, most VLA models target static manipulation in unconstrained environments, overlooking spatial constraints and dynamic obstacles. Fine-tuning VLAs on obstacle-avoidance data is a straightforward solution, but collecting such data is costly, especially for dynamic scenarios, and may degrade their original task capabilities. To address these limitations, we propose VLA-Stem, a lightweight, reinforcement-learning-based safety mechanism for VLA systems. Without fine-tuning the underlying VLA policy, VLA-Stem converts its action chunks into motion references and uses trajectory-level guidance to preserve their spatial intent while allowing flexible motion and timing adjustments. Conditioned on these references, robot proprioception, and local obstacle information, the Stem policy adaptively modifies execution at inference time, preserving the original task intent while enabling responsive adaptation to spatial constraints and dynamic obstacles. For robust and sample-efficient training, we combine teacher-student distillation with curriculum learning. We evaluate VLA-Stem on reference following, static spatial constraints, and dynamic obstacle avoidance. Across six constrained simulation settings, VLA-Stem achieves 52.8% average collision-free task success versus 23.7% for the strongest safety baseline, while preserving base-policy performance in obstacle-free settings; real-world experiments further show consistent collision reductions under static and dynamic obstacles. These results demonstrate that VLA-Stem couples high-level VLA task intent with rapid, reflex-like responses to immediate physical risks, providing a brainstem-inspired mechanism for robust robot execution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑