arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.20442cs.RO

面向智能体机器人:模型、数据、环境与管控

Towards Agentic Robots: Model, Data, Environment, and Harness

MMLab, The Chinese University of Hong Kong(香港中文大学MMLab);Fudan University(复旦大学);NovaXBot;Tsinghua University(清华大学);Zhejiang University(浙江大学);Sun Yat-sen University(中山大学)
Chonghan Qin, Dongming Wu, Kaituo Feng, Jiaxu Wang, Xinlei Yu, Peiwen Sun, Yijia Fan, Xilin He, Bingao Chen, Weitong Lian, Ryan Ji, Wenqi Ren, Xiaobin Hu, Dahua… 展开作者

Chonghan Qin, Dongming Wu, Kaituo Feng, Jiaxu Wang, Xinlei Yu, Peiwen Sun, Yijia Fan, Xilin He, Bingao Chen, Weitong Lian, Ryan Ji, Wenqi Ren, Xiaobin Hu, Dahua Lin, Yu-Gang Jiang, Xiangyu Yue

AI总结:

本文针对智能体机器人领域,梳理从机器人策略到智能体系统的发展,明确其定义与研究分类,探讨开放挑战,旨在推动该领域的清晰认知与新方法构建。

摘要:

基础模型正在推动机器人智能领域的范式转变,使其从低级动作预测转向数据收集、模型训练、任务规划及现实世界执行的目标导向编排。我们将这一新兴范式定义为智能体机器人,其中智能体可基于人类指令推理、与机器人环境交互、自主纠正执行错误并动态调整操作策略。尽管该领域发展迅速,但现有研究缺乏良好的关联性,研究人员对如何将不同智能体功能整合为完整机器人系统尚未形成一致观点。本文提供了智能体机器人现有研究的统一概述:首先追溯从机器人策略到智能体系统的发展,涵盖视觉-语言-动作模型、世界模型及世界-动作模型;随后明确智能体机器人的定义与范围,将现有研究划分为模型、数据、环境、管控四个功能领域下的17个类别;在各领域中,我们考察智能体如何影响模型学习与机器人决策、收集和整理机器人数据、构建用于学习与评估的世界、任务及测试,以及组织机器人使用的能力;最后,我们讨论开放挑战并概述未来研究方向,希望本研究有助于更清晰地理解智能体机器人,并为构建更强大、可靠、自适应的智能体机器人提供新方法。

英文摘要:

Foundation models are driving a paradigm shift in robotic intelligence, moving beyond low-level action prediction to goal-directed orchestration of data collection, model training, task planning, and real-world execution. We characterize this emerging paradigm as an agentic robots, in which agents reason over human instructions, interact with robotic environments, rectify execution errors autonomously, and dynamically adjust operational strategies. Although this field develops fast, current studies are not well connected. Researchers have no consistent view of how to combine different agentic functions into a complete robot system. This paper provides a unified overview of existing research on agentic robots. We first trace the development from robot policies to agentic systems, covering vision-language-action models, world models, and world-action models. We then clarify the definition and scope of agentic robots and organize existing research into seventeen categories across four functional domains: Model, Data, Environment, and Harness. Across these domains, we examine how agents shape model learning and robot decisions, collect and curate robot data, construct worlds, tasks, and tests for learning and evaluation, and organize capabilities for robot use. Finally, we discuss open challenges and outline directions for future research. Looking forward, we hope this work contributes to a clearer understanding of agentic robots and supports new approaches to making them more capable, reliable, and adaptive.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑