arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.08546cs.RO
收藏

通过闭环状态反馈接地LLMs用于机器人任务规划

Grounding LLMs For Robot Task Planning Using Closed-loop State Feedback

Vineet Bhat, Ali Umut Kaypak, Prashanth Krishnamurthy, Ramesh Karri, Farshad Khorrami

AI总结:

本文提出BrainBody-LLM方法,通过闭环反馈机制提升LLMs在机器人任务规划中的鲁棒性,实现在复杂任务中的显著性能提升。

摘要:

任务规划算法将复杂问题分解为可以按顺序由机器人执行的中间步骤以完成任务。近期的研究工作已利用大型语言模型(LLMs)进行任务规划,使用自然语言在仿真和现实环境中生成机器人策略。像GPT-4这样的LLMs在泛化到未见任务方面显示出有希望的结果,但由于在机器人环境中缺乏充分的 grounding,其适用性受到限制。通过环境状态信息和反馈可以增强LLMs在任务规划中的鲁棒性。在本文中,我们介绍了一种新的任务规划方法,利用两个独立的LLMs进行高层规划和低层控制,提高与任务相关的成功率和目标条件回忆率。我们的算法,BrainBody-LLM,受到人类神经系统的启发,通过将规划分解为两个LLMs的结构化、分层方式来模拟其脑-体架构。BrainBody-LLM实现了一个闭环反馈机制,使系统能够从模拟器错误中学习以解决复杂设置中的执行错误。我们展示了BrainBody-LLM在VirtualHome仿真环境中的成功应用,使用GPT-4后端实现了比竞争基线模型高29%的任务导向成功率的提升。此外,我们还评估了我们的算法在七个复杂任务上使用现实物理模拟器和Franka Research 3机械臂的表现,并将其与各种最先进的LLMs进行比较。我们的结果表明,最近的LLMs在推理能力方面有所进步,使它们能够从原始模拟器/控制器错误中学习以修正计划,使其在机器人任务规划中非常有效。

英文摘要:

Planning algorithms decompose complex problems into intermediate steps that can be sequentially executed by robots to complete tasks. Recent works have employed Large Language Models (LLMs) for task planning, using natural language to generate robot policies in both simulation and real-world environments. LLMs like GPT-4 have shown promising results in generalizing to unseen tasks, but their applicability is limited due to hallucinations caused by insufficient grounding in the robot environment. The robustness of LLMs in task planning can be enhanced with environmental state information and feedback. In this paper, we introduce a novel approach to task planning that utilizes two separate LLMs for high-level planning and low-level control, improving task-related success rates and goal condition recall. Our algorithm, \textit{BrainBody-LLM}, draws inspiration from the human neural system, emulating its brain-body architecture by dividing planning across two LLMs in a structured, hierarchical manner. BrainBody-LLM implements a closed-loop feedback mechanism, enabling learning from simulator errors to resolve execution errors in complex settings. We demonstrate the successful application of BrainBody-LLM in the VirtualHome simulation environment, achieving a 29\% improvement in task-oriented success rates over competitive baselines with the GPT-4 backend. Additionally, we evaluate our algorithm on seven complex tasks using a realistic physics simulator and the Franka Research 3 robotic arm, comparing it with various state-of-the-art LLMs. Our results show advancements in the reasoning capabilities of recent LLMs, which enable them to learn from raw simulator/controller errors to correct plans, making them highly effective in robotic task planning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑