DexWorldModel:基于因果潜在世界的建模以实现具身任务的自动化学习
DexWorldModel: Causal Latent World Modeling towards Automated Learning of Embodied Tasks
AI总结:
本文提出CLWM模型,通过分离交互语义与视觉噪声提升领域泛化能力,采用双状态测试时训练机制和推测异步推理方法,实现高效长周期任务处理,并通过EmbodiChain框架提升策略鲁棒性,实验表明其在复杂双臂仿真和物理机器人零样本迁移中表现优异。
摘要:
本文提出CLWM模型,通过分离交互语义与视觉噪声提升领域泛化能力,采用双状态测试时训练机制和推测异步推理方法,实现高效长周期任务处理,并通过EmbodiChain框架提升策略鲁棒性,实验表明其在复杂双臂仿真和物理机器人零样本迁移中表现优异。
英文摘要:
Deploying generative World-Action Models for manipulation is severely bottlenecked by redundant pixel-level reconstruction, $\mathcal{O}(T)$ memory scaling, and sequential inference latency. We introduce the Causal Latent World Model (CLWM), which employs DINOv3 features as generative targets to disentangle interaction semantics from visual noise, yielding highly robust domain generalization. To overcome memory scaling, CLWM features a Dual-State Test-Time Training (TTT) Memory that guarantees a strict $\mathcal{O}(1)$ footprint for long-horizon tasks. To overcome deployment latency, we propose Speculative Asynchronous Inference (SAI) to mask partial diffusion denoising behind physical execution, cutting blocking latency by about $50\%$. To scale robust policies, we present EmbodiChain, an online framework that establishes the Efficiency Law by injecting an infinite flow of physics-grounded trajectories during training. Extensive experiments validate that CLWM achieves state-of-the-art performance in complex dual-arm simulation and unprecedented zero-shot sim-to-real transfer on physical robots, outperforming baselines explicitly finetuned on real-world data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。