arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2508.11286cs.ROcs.AIcs.CV

面向故障韧性具身智能体的场景图引导主动重规划

Scene Graph-Guided Proactive Replanning for Failure-Resilient Embodied Agent

Korea University(韩国大学);KT (Korea Telecom) R&D Center(KT(韩国电信)研发中心)

Che Rin Yu, Daewon Chae, Dabin Seo, Sangwon Lee, Hyeongwoo Im, Jinkyu Kim

AI总结:

本文提出一种基于场景图比较的主动重规划框架,在子任务边界通过对比当前RGB-D观测与成功演示的参考图来提前检测语义和空间不匹配并调整计划,从而在AI2-THOR中显著提升任务成功率与鲁棒性。

摘要:

当人类执行日常任务时,我们会自然地根据环境的当前状态调整自己的动作。例如,如果我们想把某样东西放进抽屉,但注意到抽屉是关着的,我们会先把它打开。然而,许多自主机器人缺乏这种自适应感知能力。它们往往遵循预先规划的动作,可能忽略场景中细微但关键的变化,这可能导致动作在过时的假设下被执行并最终失败。虽然重规划对于稳健的自主性至关重要,但大多数现有方法只在故障发生后才做出响应,而此时恢复可能效率低下或不可行。虽然主动重规划有望提前预防故障,但当前解决方案通常依赖人工设计的规则和大量监督。在这项工作中,我们提出了一个主动重规划框架,该框架通过将从当前 RGB-D 观测构建的场景图与从成功演示中提取的参考图进行比较,在子任务边界检测并纠正故障。当当前场景未能与参考轨迹对齐时,会激活一个轻量级推理模块来诊断不匹配并调整计划。在 AI2-THOR 模拟器中的实验表明,我们的方法在执行故障发生之前就检测到语义和空间不匹配,显著提高了任务成功率和鲁棒性。

英文摘要:

When humans perform everyday tasks, we naturally adjust our actions based on the current state of the environment. For instance, if we intend to put something into a drawer but notice it is closed, we open it first. However, many autonomous robots lack this adaptive awareness. They often follow pre-planned actions that may overlook subtle yet critical changes in the scene, which can result in actions being executed under outdated assumptions and eventual failure. While replanning is critical for robust autonomy, most existing methods respond only after failures occur, when recovery may be inefficient or infeasible. While proactive replanning holds promise for preventing failures in advance, current solutions often rely on manually designed rules and extensive supervision. In this work, we present a proactive replanning framework that detects and corrects failures at subtask boundaries by comparing scene graphs constructed from current RGB-D observations against reference graphs extracted from successful demonstrations. When the current scene fails to align with reference trajectories, a lightweight reasoning module is activated to diagnose the mismatch and adjust the plan. Experiments in the AI2-THOR simulator demonstrate that our approach detects semantic and spatial mismatches before execution failures occur, significantly improving task success and robustness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑