arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.01166cs.RO
收藏

隐式推理VLA:面向视觉-语言-动作模型的隐式思考与预测

Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Models

Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人工智能与机器人研究院);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Institute of Automation, University of Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)

Shuanghao Bai, Jing Lyu, Wanqi Zhou, Zhe Li, Dakai Wang, Lei Xing, Xiaoguang Zhao, Pengwei Wang, Zhongyuan Wang, Cheng Chi, Badong Chen, Shanghang Zhang

AI总结:

本文提出LaRA-VLA框架,通过连续潜在表示实现多模态推理,减少推理开销,提升机器人实时控制效率。

摘要:

视觉-语言-动作(VLA)模型受益于链式推理(CoT),但现有方法存在推理开销大且依赖离散推理表示的问题。本文提出隐式推理VLA(LaRA-VLA),通过将多模态Co-T推理内化为连续潜在表示,实现统一的推理与预测。LaRA-VLA在潜在空间中执行统一推理和预测,消除了推理时的显式CoT生成,从而实现高效、以动作为导向的控制。为实现隐式具身推理,我们引入基于课程的学习范式,逐步从显式文本和视觉Co-T监督过渡到潜在推理,最终适应潜在推理动态以条件生成动作。我们构建了两个结构化的Co-T数据集,并在模拟基准和长周期真实机器人操作任务上评估LaRA-VLA。实验结果表明,LaRA-VLA在性能上优于现有最先进的VLA方法,同时将推理延迟降低了90%以上,证明了潜在推理作为实时具身控制的有效且高效的范式。项目页面:https://loveju1y.github.io/Latent-Reasoning-VLA/

英文摘要:

Vision-Language-Action (VLA) models benefit from chain-of-thought (CoT) reasoning, but existing approaches incur high inference overhead and rely on discrete reasoning representations that mismatch continuous perception and control. We propose Latent Reasoning VLA (LaRA-VLA), a unified VLA framework that internalizes multi-modal CoT reasoning into continuous latent representations for embodied action. LaRA-VLA performs unified reasoning and prediction in latent space, eliminating explicit CoT generation at inference time and enabling efficient, action-oriented control. To realize latent embodied reasoning, we introduce a curriculum-based training paradigm that progressively transitions from explicit textual and visual CoT supervision to latent reasoning, and finally adapts latent reasoning dynamics to condition action generation. We construct two structured CoT datasets and evaluate LaRA-VLA on both simulation benchmarks and long-horizon real-robot manipulation tasks. Experimental results show that LaRA-VLA consistently outperforms state-of-the-art VLA methods while reducing inference latency by up to 90\% compared to explicit CoT-based approaches, demonstrating latent reasoning as an effective and efficient paradigm for real-time embodied control. Project Page: https://loveju1y.github.io/Latent-Reasoning-VLA/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑