arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.12065cs.RO
收藏

具身学习的可扩展任务生成:基于 affordance 的任务世界

Scene2Demo: Self-Evolving Embodied Data Generation via Object-Action Graph

Xiang Liu, Sen Cui, Guocai Yao, Zhong Cao, Jingheng Ma, Min Zhang, Changshui Zhang

AI总结:

本文提出 AGT-World 框架,通过结构化图方法实现任务空间的精确分解,并结合混合反馈机制实现策略的自进化,从而提升机器人任务生成的可扩展性和泛化能力。

摘要:

在现实世界中直接训练机器人策略成本高昂且难以扩展。尽管生成式模拟能够实现大规模数据合成,但当前方法往往无法生成逻辑上一致的长周期任务,并且由于开环执行而难以应对动态物理不确定性。为解决这些问题,我们提出了 Affordance-Graphed Task Worlds (AGT-World),这是一个统一的框架,能够根据现实世界的观察自主构建交互式模拟环境及其对应的机器人任务策略。与依赖随机提案或静态复制的方法不同,AGT-World 将任务空间形式化为结构化的图,使复杂目标能够被理论上奠基的原子性原语进行精确、分层的分解。此外,我们引入了混合反馈的自进化机制,结合视觉-语言模型推理和几何验证,以自主优化策略。大量实验表明,我们的方法在成功率和泛化能力上显著优于现有方法,实现了提案、执行和修正的自我改进循环,为可扩展的机器人学习提供了新的途径。

英文摘要:

We present Scene2Demo, an automated framework for offline embodied data generation. Given a single RGB scene image and a user query, Scene2Demo constructs an interactive simulated scene and generates executable task configurations, primitive action flows, multi-view execution videos, and offline robot-learning datasets. Its five role-specialized generation modules perform task understanding, symbolic decomposition, BDDL configuration generation, object-size adjustment, and action-flow planning. The resulting object-centric task specifications and action transitions are organized as path search over a scene-conditioned object-action graph. Failed or incomplete executions are refined by two feedback agents: a Robotic Safety Inspector that produces step-wise visual critiques and a Robotic Task Supervisor that revises action sequences or parameters using the rollout and previous evolution history. Across 102 automatically generated primitive scene-task pairs, Scene2Demo achieves a 71.6% execution success rate; on four representative long-horizon tasks, feedback-driven refinement improves both task success and subtask-level execution quality over primitive-only execution. Comparisons with RoboGen and GenSim2 show stronger execution performance under automated data-generation settings. Finally, behavior cloning policies achieve 96.0% and 92.0% success on two representative tasks, showing that the generated data supports downstream policy learning. Our project page is available at https://scene2demo-anon.github.io/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑