arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.05185cs.RO

循环批评者:一种三系统VLA框架用于鲁棒的长周期操控

Critic in the Loop: A Tri-System VLA Framework for Robust Long-Horizon Manipulation

Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);the School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)

Pengfei Yi, Yingjie Ma, Wenjiang Xu, Yanan Hao, Shuai Gan, Wanting Li, Shanlin Zhong

AI总结:

循环批评者提出了一种三系统VLA框架,通过动态调度VLM和VLA实现鲁棒的长周期操控,提升系统在分布外场景的自主性和鲁棒性。

摘要:

在视觉机器人操控中,平衡高层语义推理与低层反应控制仍然是核心挑战。虽然视觉-语言模型(VLMs)在认知规划方面表现出色,但其推理延迟阻止了实时执行。相反,快速的视觉-语言-动作(VLA)模型往往缺乏复杂、长周期任务所需的语义深度。为此,我们引入了循环批评者,一种由动态VLM-专家调度驱动的自适应分层框架。其核心是一个生物启发的三系统架构,包括一个用于全局推理的VLM大脑、一个用于反应执行的VLA小脑,以及一个轻量级的视觉批评者。通过持续监控工作空间,批评者动态分配控制权。它通过VLA维持快速闭环执行以处理常规子任务,并在检测到执行异常(如任务停滞或失败)时自适应触发VLM进行重新规划。此外,我们的架构无缝集成了受人类启发的规则,以直观地打破无限重试循环。这种视觉引导的调度减少了昂贵的VLM查询,同时显著增强了系统在分布外(OOD)场景中的鲁棒性和自主性。在具有挑战性的长周期操控基准上的全面实验表明,我们的方法实现了最先进的性能。

英文摘要:

Balancing high-level semantic reasoning with low-level reactive control remains a core challenge in visual robotic manipulation. While Vision-Language Models (VLMs) excel at cognitive planning, their inference latency precludes real-time execution. Conversely, fast Vision-Language-Action (VLA) models often lack the semantic depth required for complex, long-horizon tasks. To bridge this gap, we introduce Critic in the Loop, an adaptive hierarchical framework driven by dynamic VLM-Expert scheduling. At its core is a bionic Tri-System architecture comprising a VLM brain for global reasoning, a VLA cerebellum for reactive execution, and a lightweight visual Critic. By continuously monitoring the workspace, the Critic dynamically routes control authority. It sustains rapid closed-loop execution via the VLA for routine subtasks, and adaptively triggers the VLM for replanning upon detecting execution anomalies such as task stagnation or failures. Furthermore, our architecture seamlessly integrates human-inspired rules to intuitively break infinite retry loops. This visually-grounded scheduling minimizes expensive VLM queries, while substantially enhancing system robustness and autonomy in out-of-distribution (OOD) scenarios. Comprehensive experiments on challenging, long-horizon manipulation benchmarks reveal that our approach achieves state-of-the-art performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑