arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.01663cs.RO
收藏

DaDu-E:重新思考大型语言模型在机器人计算流水线中的作用

DaDu-E: Rethinking the Role of Large Language Model in Robotic Computing Pipeline

Institute of Computing Technology, Chinese Academy of Sciences (ICT, CAS)(中国科学院计算技术研究所);University of Chinese Academy of Sciences (UCAS)(中国科学院大学);Beijing Institute of Technology (BIT)(北京理工大学);Institute of Automation, Chinese Academy of Science (CASIA)(中国科学院自动化研究所);Shenzhen Institute of Artificial Intelligence and Robotics for Society (AIRS)(深圳市人工智能与机器人研究院)

Wenhao Sun, Sai Hou, Zixuan Wang, Bo Yu, Shaoshan Liu, Xu Yang, Shuai Liang, Yiming Gan, Yinhe Han

AI总结:

本文提出DaDu-E闭环机器人规划框架,通过轻量级LLM、技能指令、反馈与记忆增强,在保持与大模型规划器相当成功率的同时将计算需求降低6.6倍。

摘要:

对于机器人而言,在开放环境中执行复杂任务仍然具有挑战性,即便使用大型语言模型(LLM)作为核心规划器也是如此。许多基于LLM的规划器由于参数量庞大而效率低下,并且由于运行在开环系统中而容易出现不准确。我们认为其原因在于,仅将LLM用作规划器是不够的。在本工作中,我们提出了DaDu-E,这是一个面向具身AI机器人的鲁棒闭环规划框架。具体而言,DaDu-E配备了一个相对轻量级的LLM、一组封装好的机器人技能指令、一个鲁棒的反馈系统以及记忆增强。这些组件共同使DaDu-E能够:(i)主动感知并适应动态环境;(ii)在保持高性能的同时优化计算成本;(iii)利用其记忆和反馈机制从执行失败中恢复。在真实世界和仿真任务上的大量实验表明,DaDu-E取得了与采用COME-Robot等更大模型作为规划器的具身AI机器人相当的任务成功率,同时将计算需求降低了6.6倍。欢迎用户访问我们的系统:https://rlc-lab.github.io/dadu-e/。

英文摘要:

Performing complex tasks in open environments remains challenging for robots, even when using large language models (LLMs) as the core planner. Many LLM-based planners are inefficient due to their large number of parameters and prone to inaccuracies because they operate in open-loop systems. We think the reason is that only applying LLMs as planners is insufficient. In this work, we propose DaDu-E, a robust closed-loop planning framework for embodied AI robots. Specifically, DaDu-E is equipped with a relatively lightweight LLM, a set of encapsulated robot skill instructions, a robust feedback system, and memory augmentation. Together, these components enable DaDu-E to (i) actively perceive and adapt to dynamic environments, (ii) optimize computational costs while maintaining high performance, and (iii) recover from execution failures using its memory and feedback mechanisms. Extensive experiments on real-world and simulated tasks show that DaDu-E achieves task success rates comparable to embodied AI robots with larger models as planners like COME-Robot, while reducing computational requirements by $6.6 \times$. Users are encouraged to explore our system at: \url{https://rlc-lab.github.io/dadu-e/}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑