arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2505.20573cs.ROcs.AI
收藏

基于基础化大语言模型规划器的碰撞与可达性感知多机器人控制

Collision- and Reachability-Aware Multi-Robot Control with Grounded LLM Planners

UC Santa Barbara(加州大学圣巴巴拉分校);MIT(麻省理工学院);Harvard University(哈佛大学);MIT-IBM Watson AI Lab(MIT-IBM沃森人工智能实验室);Cisco Research(思科研究院)

Jiabao Ji, Yongchao Chen, Yang Zhang, Ramana Rao Kompella, Chuchu Fan, Gaowen Liu, Shiyu Chang

AI总结:

本文提出将强化学习与可验证奖励(RLVR)相结合,使小规模大语言模型在生成多机器人控制计划时具备碰撞与可达性等物理约束感知能力,并在BoxNet和BoxNet3D环境中验证其优于无约束的大规模模型。

摘要:

大语言模型(LLMs)已在多种机器人控制任务中展现出强大性能,但其在真实应用中的部署仍受限制。即便是最先进的大语言模型,如GPT-o4mini,也经常生成违反物理约束的无效动作计划,例如将机器人引导至不可达位置或导致机器人之间发生碰撞。这一问题主要源于推理过程中缺乏对这些物理约束的感知。为解决该问题,我们提出了一种新颖的框架,将强化学习与可验证奖励(RLVR)相结合,以激励大语言模型学习物理约束知识,从而在计划生成过程中引入约束感知推理。在该方法中,只有成功完成控制任务的有效动作计划才能获得正奖励。我们将该方法应用于两个小规模大语言模型:非推理型Qwen2.5-3B-Instruct和推理型Qwen3-4B。实验结果表明,在BoxNet任务以及使用MuJoCo构建的新BoxNet3D环境中,具备约束感知的小规模大语言模型在性能上大幅优于无约束的大规模模型。本工作凸显了即使是对小规模大语言模型进行物理约束基础化,也能在复杂且受物理约束的环境中实现可扩展且高效的多机器人控制。

英文摘要:

Large language models (LLMs) have demonstrated strong performance in various robot control tasks. However, their deployment in real-world applications remains constrained. Even state-ofthe-art LLMs, such as GPT-o4mini, frequently produce invalid action plans that violate physical constraints, such as directing a robot to an unreachable location or causing collisions between robots. This issue primarily arises from a lack of awareness of these physical constraints during the reasoning process. To address this issue, we propose a novel framework that integrates reinforcement learning with verifiable rewards (RLVR) to incentivize knowledge of physical constraints into LLMs to induce constraints-aware reasoning during plan generation. In this approach, only valid action plans that successfully complete a control task receive positive rewards. We applied our method to two small-scale LLMs: a non-reasoning Qwen2.5-3B-Instruct and a reasoning Qwen3-4B. The experiment results demonstrate that constraint-aware small LLMs largely outperform large-scale models without constraints, grounded on both the BoxNet task and a newly developed BoxNet3D environment built using MuJoCo. This work highlights the effectiveness of grounding even small LLMs with physical constraints to enable scalable and efficient multi-robot control in complex, physically constrained environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑