arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.18336cs.RO
收藏

ManiDreams:一种基于不确定性强鲁棒物体操作的开源库

ManiDreams: An Open-Source Library for Robust Object Manipulation via Uncertainty-aware Task-specific Intuitive Physics

Department of Computer Science, Rice University, Houston, TX 77005, USA(计算机科学系,里士大学,德克萨斯州休斯敦,77005,美国);Robotics and AI Institute, Cambridge, MA 02142, USA(机器人与人工智能研究所,马萨诸塞州剑桥,02142,美国)

Gaotian Wang, Kejia Ren, Andrew S. Morgan, Kaiyu Hang

AI总结:

ManiDreams通过整合不确定性表示、传播和约束,提升机器人操作的鲁棒性,实验表明其在多种扰动下表现优于传统RL方法。

摘要:

动力学模型,无论是模拟器还是学习的世界模型,长期以来都是机器人操作的核心,但大多数研究集中在最小化预测误差而非应对更根本的挑战:现实中的操作本质上是不确定的。本文提出并开源了ManiDreams,一个模块化的框架,用于在直观物理模型上进行不确定性感知的操作规划。该框架通过可组合的抽象实现分布状态表示、后端无关的动力学预测和声明性约束规范,以优化动作。框架明确处理三种不确定性来源:感知、参数和结构。它将任何基础策略封装在样本预测-约束循环中,评估候选动作的分布结果,从而在不重新训练的情况下增加鲁棒性。在ManiSkill任务上的实验表明,ManiDreams在各种扰动下保持稳健性能,优于RL基线。可运行示例展示了在推、拾、接和现实部署中的灵活性,适用于不同策略、优化器、物理后端和执行器。该框架在https://github.com/Rice-RobotPI-Lab/ManiDreams上公开可用。

英文摘要:

Dynamics models, whether simulators or learned world models, have long been central to robotic manipulation, but most focus on minimizing prediction error rather than confronting a more fundamental challenge: real-world manipulation is inherently uncertain. We argue that robust manipulation under uncertainty is fundamentally an integration problem: uncertainties must be represented, propagated, and constrained within the planning loop, not merely suppressed during training. We present and open-source ManiDreams, a modular framework for uncertainty-aware manipulation planning over intuitive physics models. It realizes this integration through composable abstractions for distributional state representation, backend-agnostic dynamics prediction, and declarative constraint specification for action optimization. The framework explicitly addresses three sources of uncertainty: perceptual, parametric, and structural. It wraps any base policy with a sample-predict-constrain loop that evaluates candidate actions against distributional outcomes, adding robustness without retraining. Experiments on ManiSkill tasks show that ManiDreams maintains robust performance under various perturbations where the RL baseline degrades significantly. Runnable examples on pushing, picking, catching, and real-world deployment demonstrate flexibility across different policies, optimizers, physics backends, and executors. The framework is publicly available at https://github.com/Rice-RobotPI-Lab/ManiDreams

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑