自适应的递归模型在仿真对象学习中的应用
Self-Adapting Recurrent Models for Object Pushing from Learning in Simulation
摘要:
平面推送是一个具有挑战性的研究课题,其核心问题是建立相互作用的动力学模型。即使是一个精确的分析动态模型本质上是不稳定的,因为物理参数,如惯性和摩擦只能近似。数据驱动模型通常依赖于大量的训练数据,但在使用真实机器人时,数据汇集非常耗时。在本文中,我们收集了所有的训练数据在物理模拟器,并建立了一个基于LSTM的模型,以适应推动动力学。域随机化被应用于捕获广义对象类的推动轨迹。当在真实机器人上执行时,经过训练的递归模型在几个步骤内适应被跟踪对象的真实动态。我们提出了算法\emph{Recurrent}模型预测路径积分(RMPPI)作为一个变化的原始MPPI方法,采用状态依赖的经常性模型。作为比较,我们还训练了一个深度确定性策略梯度(DDPG)网络作为无模型基线,它也被用作数据汇集阶段的动作生成器。在策略训练中,采用后见之明经验回放的方法来提高探索效率。在UR5平台上的推流实验证明了模型的适应性和框架的有效性。
英文摘要:
Planar pushing remains a challenging research topic, where building the dynamic model of the interaction is the core issue. Even an accurate analytical dynamic model is inherently unstable because physics parameters such as inertia and friction can only be approximated. Data-driven models usually rely on large amounts of training data, but data collection is time consuming when working with real robots. In this paper, we collect all training data in a physics simulator and build an LSTM-based model to fit the pushing dynamics. Domain Randomization is applied to capture the pushing trajectories of a generalized class of objects. When executed on the real robot, the trained recursive model adapts to the tracked object's real dynamics within a few steps. We propose the algorithm \emph{Recurrent} Model Predictive Path Integral (RMPPI) as a variation of the original MPPI approach, employing state-dependent recurrent models. As a comparison, we also train a Deep Deterministic Policy Gradient (DDPG) network as a model-free baseline, which is also used as the action generator in the data collection phase. During policy training, Hindsight Experience Replay is used to improve exploration efficiency. Pushing experiments on our UR5 platform demonstrate the model's adaptability and the effectiveness of the proposed framework.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。