arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.22018cs.RO
收藏

PocketDP3: 高效的微型3D视觉-运动政策

PocketDP3: Efficient Pocket-Scale 3D Visuomotor Policy

Jinhao Zhang, Zhexuan Zhou, Huizhe Li, Yichen Lai, Wenlong Xia, Haoming Song, Youmin Gong, Jie Mei

AI总结:

PocketDP3通过轻量级扩散混合器替代传统解码器,实现高效3D视觉-运动策略,减少参数消耗并提升实时部署性能。

摘要:

最近,基于3D视觉的扩散策略在学习复杂的机器人操作技能方面表现出强大的能力。然而,这些模型中存在一个常见的架构不匹配问题:一个小巧而高效的点云编码器通常与一个庞大的解码器配对。给定一个紧凑的场景表示,我们认为这可能导致解码器中出现显著的参数浪费。受这一观察的启发,我们提出了PocketDP3,一种微型3D扩散策略,它用基于MLP-Mixer块构建的轻量级扩散混合器(DiM)取代了先前方法中使用的重型条件U-Net解码器。这种架构实现了时间维度和通道维度之间的高效融合,显著减少了模型大小。值得注意的是,在不采用任何额外的一致性蒸馏技术的情况下,我们的方法支持两步推理而不牺牲性能,提高了在实时部署中的实用性。在三个模拟基准测试——RoboTwin2.0、Adroit和MetaWorld中,PocketDP3以少于先前方法1%的参数实现了最先进的性能,同时加速了推理。实际实验进一步证明了我们的方法在实际环境中的实用性和可迁移性。代码将被发布。

英文摘要:

Recently, 3D vision-based diffusion policies have shown strong capability in learning complex robotic manipulation skills. However, a common architectural mismatch exists in these models: a tiny yet efficient point-cloud encoder is often paired with a massive decoder. Given a compact scene representation, we argue that this may lead to substantial parameter waste in the decoder. Motivated by this observation, we propose PocketDP3, a pocket-scale 3D diffusion policy that replaces the heavy conditional U-Net decoder used in prior methods with a lightweight Diffusion Mixer (DiM) built on MLP-Mixer blocks. This architecture enables efficient fusion across temporal and channel dimensions, significantly reducing model size. Notably, without any additional consistency distillation techniques, our method supports two-step inference without sacrificing performance, improving practicality for real-time deployment. Across three simulation benchmarks--RoboTwin2.0, Adroit, and MetaWorld--PocketDP3 achieves state-of-the-art performance with fewer than 1% of the parameters of prior methods, while also accelerating inference. Real-world experiments further demonstrate the practicality and transferability of our method in real-world settings. Code will be released.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑