arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.28156cs.RO
收藏

通过按需人类协助减少LLM多机器人协调中的心理负荷

On-Demand Human Assistance for Task Continuation under Physical Action Failures in LLM-based Planning

Ritsumeikan University(立命馆大学);Kyoto University(京都大学)

Shoichi Hasegawa, Akira Taniguchi, Lotfi El Hafi, Gustavo Alfonso Garcia Ricardez, Tadahiro Taniguchi

AI总结:

本文提出REPAIR框架,通过在LLM多机器人规划中集成远程错误修复,提升任务进度并减少操作员心理负荷。

摘要:

基于大语言模型(LLM)的多机器人协调已引起广泛关注,因为LLM能够通过分解任务和生成高层计划将自然语言指令直接转化为机器人行动计划。然而,恢复物理执行失败仍然困难,任务常因重复相同失败动作而停滞。尽管已提出利用混合现实进行远程机器人操作的框架,但针对多机器人环境中物理失败的远程错误修复仍鲜有尝试。本文提出REPAIR(机器人执行与计划和交互恢复)框架,是一种集成远程错误修复的闭环框架。在该方法中,机器人自主执行任务;当发生不可恢复的失败时,LLM会请求操作员协助,通过远程干预实现任务连续性。在真实环境中的多机器人垃圾收集任务评估中,REPAIR在时间限制内清除的物品数量显著优于完全自主方法。此外,对于易于收集的物品,其任务进度等同于完全远程控制。结果还表明,操作员的心理负荷可能在物理需求和努力方面存在差异。项目网站为https://emergentsystemlabstudent.github.io/REPAIR/。

英文摘要:

While robot action planning based on large language models (LLMs) has advanced remarkably, continuing a task after a physical action failure during execution remains a key challenge. For example, after failing to grasp an object, the robot may not notice that it has fallen off the table and keep trying to detect and pick it up, stalling the task. Existing approaches either rely on closed-loop autonomous re-planning, which fails when errors exceed the robot's capabilities, or on human intervention without updating the LLM's plan, hindering subsequent planning. We present a system for LLM-based robot action planning that integrates remote human intervention with feedback-based replanning. When the LLM detects an action failure, the robot requests remote assistance; an operator resolves the failure through teleoperation and reports the outcome in natural language, which is fed back to the LLM to update its plan so that the task can continue. We evaluated the proposed system on a real-world trash-collection task, comparing it with a fully autonomous method and a teleoperation-only baseline. The proposed system improves task progress over the autonomous method in this case study. For easy-to-retrieve trash, the gap from the teleoperation reference was small, while a larger gap remained for harder-to-retrieve trash. These results suggest that, in this case study, combining remote human intervention with feedback-based replanning was associated with continued task execution even in the face of otherwise unrecoverable failures. The project website is https://emergentsystemlabstudent.github.io/REPAIR/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑