arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.19510cs.ROcs.CL

ALRM:用于机器人操作的代理LLM

ALRM: Agentic LLM for Robotic Manipulation

Vitor Gaboardi dos Santos, Ibrahim Khadraoui, Ibrahim Farhat, Hamza Yous, Samy Teffahi, Hakim Hacid

AI总结:

ALRM提出了一种基于LLM的代理框架,通过ReAct推理循环实现机器人操作的模块化执行,支持代码生成和工具规划模式,实验表明其在多步骤推理和语言多样性任务中表现优异。

摘要:

大型语言模型(LLMs)最近使代理框架能够展示出先进的推理和规划能力。然而,它们在机器人控制管道中的整合仍然存在两个方面的限制:(1)先前基于LLM的方法通常缺乏模块化、代理执行机制,限制了它们在闭环中计划、反思结果和修订动作的能力;(2)现有的机器人操作任务基准主要关注低层控制,没有系统地评估多步骤推理和语言变异。在本文中,我们提出了用于机器人操作的代理LLM(ALRM),一种由LLM驱动的代理框架。ALRM通过ReAct风格的推理循环将策略生成与代理执行结合起来,支持两种互补模式:Code-as-Policy(CaP)用于直接生成可执行的控制代码,以及Tool-as-Policy(TaP)用于迭代规划和基于工具的动作执行。为了实现系统评估,我们还引入了一个包含56个任务的新型模拟基准,涵盖多个环境,捕捉语言多样性的指令。实验表明,ALRM提供了一种可扩展、可解释和模块化的桥梁,将自然语言推理与可靠的机器人执行相结合。结果揭示Claude-4.1-Opus是闭源模型中的最佳选择,Falcon-H1-7B是开源模型中的最佳选择。

英文摘要:

Large Language Models (LLMs) have recently empowered agentic frameworks to exhibit advanced reasoning and planning capabilities. However, their integration in robotic control pipelines remains limited in two aspects: (1) prior \ac{llm}-based approaches often lack modular, agentic execution mechanisms, limiting their ability to plan, reflect on outcomes, and revise actions in a closed-loop manner; and (2) existing benchmarks for manipulation tasks focus on low-level control and do not systematically evaluate multistep reasoning and linguistic variation. In this paper, we propose Agentic LLM for Robot Manipulation (ALRM), an LLM-driven agentic framework for robotic manipulation. ALRM integrates policy generation with agentic execution through a ReAct-style reasoning loop, supporting two complementary modes: Code-asPolicy (CaP) for direct executable control code generation, and Tool-as-Policy (TaP) for iterative planning and tool-based action execution. To enable systematic evaluation, we also introduce a novel simulation benchmark comprising 56 tasks across multiple environments, capturing linguistically diverse instructions. Experiments with ten LLMs demonstrate that ALRM provides a scalable, interpretable, and modular approach for bridging natural language reasoning with reliable robotic execution. Results reveal Claude-4.1-Opus as the top closed-source model and Falcon-H1-7B as the top open-source model under CaP.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑