发表机构
ByteDance(字节跳动)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
研究针对可泛化机器人操作策略受数据限制的问题,提出TableVerse全自动Real2Sim管道,能将无脚本互联网媒体处理成高保真桌面环境,还集成轨迹生成框架,构建了TableVerse-100K数据集,为相关研究提供数据基础。
AI 中文摘要
可泛化机器人操作策略的发展受到大规模、高保真场景数据可用性的限制。虽然最近的自动合成方法试图通过文本到布局的幻觉或简化的程序生成来弥合这一差距,但它们经常存在物理上的不合理性,无法捕捉实际人类环境中复杂、密集的杂乱情况。在本文中,我们引入了TableVerse,这是一个全自动的Real2Sim管道,将范式从想象性布局生成转变为从非结构化的野外图像数据进行确定性重建。我们的框架无缝地将无脚本的互联网媒体处理成具有精确度量尺度、真实拓扑和经过验证的机械稳定性的高保真、可用于模拟的桌面环境。此外,还集成了一个自动的任务条件轨迹生成框架来合成高质量、无碰撞的抓取和放置演示。利用这个完整的管道,我们构建了TableVerse-100K数据集,这是一个大规模语料库,包含100,000个独特的、物理上一致的环境以及交互式操作轨迹。通过捕捉多样化的资产组成、现实的空间分布和高质量的演示,TableVerse-100K建立了一个高度可扩展和高保真的数据基础,为促进可泛化机器人操作任务的未来研究提供了重要价值。
英文摘要
The development of generalizable robotic manipulation policies is inherently bounded by the availability of large-scale, high-fidelity scene data. While recent automated synthesis methods attempt to bridge this gap via text-to-layout hallucination or simplified procedural generation, they frequently suffer from physical implausibility and fail to capture the complex, dense clutter of actual human environments. In this paper, we introduce TableVerse, a fully automated Real2Sim pipeline that shifts the paradigm from imaginative layout generation to deterministic reconstruction from unstructured, in-the-wild image data. Our framework seamlessly processes unscripted internet media into high-fidelity, simulation-ready tabletop environments with accurate metric scales, authentic topologies, and verified mechanical stability. Furthermore, an automated task-conditioned trajectory generation framework is integrated to synthesize high-quality, collision-free pick-and-place demonstrations. Leveraging this complete pipeline, we construct the TableVerse-100K Dataset, a large-scale corpus comprising 100,000 unique, physically consistent environments paired with interactive manipulation trajectories. By capturing diverse asset compositions, realistic spatial distributions, and high-quality demonstrations, TableVerse-100K establishes a highly scalable and high-fidelity data foundation, providing significant value to facilitate future research in generalizable robotic manipulation tasks.