arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2610.17657cs.RO
收藏

面向完整任务执行周期的具身系统2的系统性研究

Towards a Systematic Study of Embodied System 2 over Full Task Execution Cycles

The University of Hong Kong(香港大学);Morphi Robot(墨飞机器人);Fudan University(复旦大学);Shanghai Jiao Tong University(上海交通大学)

Yuxi Wei, Ye Fang, Shuai Yang, Tong Wu, Tai Wang, Xiaojuan Qi

AI总结:

研究人员推出SCOPER套件及配套工具,解决具身系统2在任务执行周期中的困难,提升了任务成功率与动作准确率。

摘要:

具身大脑(即系统2)必须将抽象目标转化为动作,同时发现相关场景条件并检查执行的技能是否达到预期效果。开环评估无法测试智能体决策所塑造的观察结果,而部分闭环评估仅在执行过程中提供有限证据,或假设技能结果理想化。我们推出SCOPER,一套用于研究基于观察的规划、执行与恢复的工具套件。SCOPER-bench结合了高级目标、持续视觉观察、用于低级动作的共享基于规则的系统1,以及可控执行故障。其构建与验证流程在BEHAVIOR和ProcTHOR中生成了870个任务,还补充了约3500个与被评估智能体执行情况绑定的情境化问题。基准结果显示,智能体存在保留场景证据、监控进度以及从意外结果中恢复的困难。为解决这些困难,SCOPER-harness结合了证据记忆、进度验证、动态任务议程与有界探索,无需额外模型训练。在两个被评估的开源骨干模型和两个模拟器上,该工具将任务成功率提升了11.1%至28.6%;配备该工具的9B模型在两个模拟器上的表现优于直接执行的27B模型。在使用200个真实机器人演示的观察结果进行的离线下一个动作评估中,该工具还将全调用准确率提升了14.7%和15.3%。SCOPER为在完整任务执行周期内诊断和改进具身推理提供了场景。

英文摘要:

An embodied brain, or System 2, must turn an abstract goal into actions while discovering relevant scene conditions and checking whether executed skills achieved their intended effects. Open-loop evaluations cannot test observations shaped by an agent's decisions, while some closed-loop evaluations provide limited evidence during execution or assume idealized skill outcomes. We introduce SCOPER, a suite for studying observation-grounded planning, execution, and recovery. SCOPER-bench combines high-level goals, ongoing visual observations, a shared rule-based System 1 for low-level actions, and controlled execution failures. Its construction and validation pipeline yields 870 tasks across BEHAVIOR and ProcTHOR, complemented by about 3,500 situated questions tied to the evaluated agent's execution. Benchmark results reveal difficulties in retaining scene evidence, monitoring progress, and recovering from unexpected outcomes. To address these difficulties, SCOPER-harness combines Evidence Memory and Progress Verification with a dynamic task agenda and bounded exploration, without additional model training. Across two evaluated open-source backbones and two simulators, the harness improves task success by 11.1-28.6%; a harnessed 9B model outperforms a directly executed 27B model on both simulators. In an offline next-action evaluation using observations from 200 real-robot demonstrations, the harness also improves full-call accuracy by 14.7% and 15.3%. SCOPER provides a setting for diagnosing and improving embodied reasoning throughout a complete task execution cycle.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑