arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.11552cs.ROcs.AI
收藏

LLM3:基于大语言模型的任务与运动规划及运动失败推理

LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoning

University of California, Los Angeles(加州大学洛杉矶分校);BIGAI(北京智源人工智能研究院)

Shu Wang, Muzhi Han, Ziyuan Jiao, Zeyu Zhang, Ying Nian Wu, Song-Chun Zhu, Hangxin Liu

AI总结:

提出LLM^3框架,利用大语言模型通过运动失败推理迭代优化任务与运动规划,实现领域无关接口,仿真与物理实验验证其有效性与实用性。

摘要:

传统的任务与运动规划(TAMP)方法依赖于手工构建的接口,将符号任务规划与连续运动生成相连接。这些特定领域且劳动密集型的模块在处理现实环境中的新兴任务时存在局限。在此,我们提出LLM^3,一种新颖的基于大语言模型(LLM)的TAMP框架,其特点是具有领域无关的接口。具体而言,我们利用预训练大语言模型强大的推理和规划能力,提出符号动作序列并为运动规划选择连续动作参数。关键的是,LLM^3通过提示方式整合运动规划反馈,使大语言模型能够通过推理运动失败来迭代优化其提议。因此,LLM^3在任务规划与运动规划之间建立接口,减轻了处理两者之间领域特定消息的复杂设计过程。通过在装箱域中的一系列仿真,我们定量证明了LLM^3在解决TAMP问题方面的有效性以及选择动作参数的效率。消融研究强调了运动失败推理对LLM^3成功的重要贡献。此外,我们在物理机械臂上进行了定性实验,展示了我们方法在现实环境中的实际适用性。

英文摘要:

Conventional Task and Motion Planning (TAMP) approaches rely on manually crafted interfaces connecting symbolic task planning with continuous motion generation. These domain-specific and labor-intensive modules are limited in addressing emerging tasks in real-world settings. Here, we present LLM^3, a novel Large Language Model (LLM)-based TAMP framework featuring a domain-independent interface. Specifically, we leverage the powerful reasoning and planning capabilities of pre-trained LLMs to propose symbolic action sequences and select continuous action parameters for motion planning. Crucially, LLM^3 incorporates motion planning feedback through prompting, allowing the LLM to iteratively refine its proposals by reasoning about motion failure. Consequently, LLM^3 interfaces between task planning and motion planning, alleviating the intricate design process of handling domain-specific messages between them. Through a series of simulations in a box-packing domain, we quantitatively demonstrate the effectiveness of LLM^3 in solving TAMP problems and the efficiency in selecting action parameters. Ablation studies underscore the significant contribution of motion failure reasoning to the success of LLM^3. Furthermore, we conduct qualitative experiments on a physical manipulator, demonstrating the practical applicability of our approach in real-world settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑