arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.09574cs.ROcs.LG
收藏

SCDP:通过混合观测蒸馏从部分观测中学习人形机器人的运动

SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation

Milo Carroll, Tianhu Peng, Lingfan Bao, Chengxu Zhou, Zhibin Li

AI总结:

SCDP通过混合观测蒸馏从部分观测中学习人形机器人运动,利用机载传感器实现高效可靠的真实机器人运动控制。

摘要:

从离线数据集中蒸馏出可用于部署的人形运动控制策略仍是一个挑战,因为现有方法依赖于特权的完整身体状态,这需要复杂的且往往不可靠的状态估计。我们提出了传感器条件扩散策略(SCDP),该策略仅使用机载传感器即可实现人形运动,消除了显式状态估计的需要。SCDP通过混合观测训练将感知与监督解耦:扩散模型对传感器历史进行条件处理,同时被监督以预测特权的未来状态-动作轨迹,迫使模型在部分可观测性下推断运动动力学。我们进一步开发了受限去噪、上下文分布对齐和上下文感知注意力掩码,以鼓励模型内部的隐式状态估计,并防止训练-部署不匹配。我们在速度命令运动和运动参考跟踪任务上验证了SCDP。在模拟中,SCDP在速度控制方面几乎完美(99-100%),在AMASS测试集上的跟踪成功率达到93%,其性能与特权基线相当,但仅使用机载传感器。最后,我们将训练好的策略部署在实际的G1人形机器人上,以50 Hz的速度运行,展示了无需外部传感或状态估计的鲁棒真实机器人运动。

英文摘要:

Distilling humanoid locomotion control from offline datasets into deployable policies remains a challenge, as existing methods rely on privileged full-body states that require complex and often unreliable state estimation. We present Sensor-Conditioned Diffusion Policies (SCDP) that enables humanoid locomotion using only onboard sensors, eliminating the need for explicit state estimation. SCDP decouples sensing from supervision through mixed-observation training: diffusion model conditions on sensor histories while being supervised to predict privileged future state-action trajectories, enforcing the model to infer the motion dynamics under partial observability. We further develop restricted denoising, context distribution alignment, and context-aware attention masking to encourage implicit state estimation within the model and to prevent train-deploy mismatch. We validate SCDP on velocity-commanded locomotion and motion reference tracking tasks. In simulation, SCDP achieves near-perfect success on velocity control (99-100%) and 93% tracking success in AMASS test set, performing comparable to privileged baselines while using only onboard sensors. Finally, we deploy the trained policy on a real G1 humanoid at 50 Hz, demonstrating robust real robot locomotion without external sensing or state estimation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑