arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.02018cs.ROcs.AI
收藏

用于协调双臂机器人的大语言模型

Large Language Models for Orchestrating Bimanual Robots

University of Hamburg(汉堡大学)

Kun Chu, Xufeng Zhao, Cornelius Weber, Mengdi Li, Wenhao Lu, Stefan Wermter

AI总结:

针对双臂机器人连续空间协调难题,提出基于大语言模型的双臂协调智能体LABOR,通过LLM分析任务并制定协调策略,在NICOL机器人仿真实验中成功率优于基线。

摘要:

尽管赋予机器人解决复杂操作任务的能力已取得快速进展,但为双臂机器人生成控制策略以解决涉及双手的任务仍具挑战性,原因在于有效的时间与空间协调存在难度。凭借逐步推理和上下文学习的涌现能力,大语言模型(LLM)已在各类机器人任务中展现出可观潜力。然而,语言通过单序列离散符号进行通信的特性,使得基于LLM的连续空间协调成为双臂任务面临的一项特殊挑战。为应对这一挑战,我们提出了基于语言模型的双臂协调系统LABOR(LAnguage-model-based Bimanual ORchestration),这是一种利用LLM分析任务配置并制定协调控制策略的智能体,用于解决长时序双臂任务。我们通过涉及两类长时序任务的仿真实验,使用NICOL人形机器人对所提方法进行了评估。结果表明,我们的方法在成功率上优于基线方法。此外,我们对失败案例进行了全面分析,为基于LLM的双臂机器人控制方法提供了见解,并揭示了未来的研究方向。项目网站可访问:http://labor-agent.github.io。

英文摘要:

Although there has been rapid progress in endowing robots with the ability to solve complex manipulation tasks, generating control policies for bimanual robots to solve tasks involving two hands is still challenging because of the difficulties in effective temporal and spatial coordination. With emergent abilities in terms of step-by-step reasoning and in-context learning, Large Language Models (LLMs) have demonstrated promising potential in a variety of robotic tasks. However, the nature of language communication via a single sequence of discrete symbols makes LLM-based coordination in continuous space a particular challenge for bimanual tasks. To tackle this challenge, we present LAnguage-model-based Bimanual ORchestration (LABOR), an agent utilizing an LLM to analyze task configurations and devise coordination control policies for addressing long-horizon bimanual tasks. We evaluate our method through simulated experiments involving two classes of long-horizon tasks using the NICOL humanoid robot. Our results demonstrate that our method outperforms the baseline in terms of success rate. Additionally, we thoroughly analyze failure cases, offering insights into LLM-based approaches in bimanual robotic control and revealing future research trends. The project website can be found at http://labor-agent.github.io.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑