arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1611.05095cs.LGcs.ROcs.SYeess.SY
收藏

从经验与模仿中学习灵巧操作策略

Learning Dexterous Manipulation Policies from Experience and Imitation

Vikash Kumar, Abhishek Gupta, Emanuel Todorov, Sergey Levine

AI总结:

本文研究了通过经验与模仿学习反馈控制灵巧五指手非抓取操作的任务,提出基于轨迹优化的局部控制器,并通过深度学习和最近邻方法进行泛化,展示了小数据训练下的有效性和盲操作优势。

摘要:

我们探索了基于学习的反馈控制方法,用于控制执行非抓取操作的灵巧五指手。首先,我们学习了能够从预定义初始状态开始执行任务的局部控制器。这些控制器是通过轨迹优化构建的,基于从传感器数据直接学习到的局部线性时变模型。在某些情况下,我们使用通过虚拟环境中的遥控收集的人类示范来初始化优化器。我们证明,这些控制器在模拟和物理平台上都能在初始条件的有限范围内稳健地执行任务。然后,我们考虑了两种泛化方法:深度学习和最近邻。我们发现最近邻方法性能更高。然而,神经网络也有其优势:它仅使用触觉和本体感觉反馈,而没有关于物体的视觉反馈(即盲操作),并且学习了一个时间不变的策略。相比之下,最近邻方法根据运动捕捉感知的初始物体状态切换时间变化的局部控制器。尽管两种泛化方法仍有改进空间,我们的工作表明(i)复杂的非抓取操作任务的局部轨迹控制器可以从惊人的少量训练数据中构建,(ii)此类控制器的集合可以插值形成更全局的控制器。结果总结在补充视频中:https://youtu.be/E0wmO6deqjo

英文摘要:

We explore learning-based approaches for feedback control of a dexterous five-finger hand performing non-prehensile manipulation. First, we learn local controllers that are able to perform the task starting at a predefined initial state. These controllers are constructed using trajectory optimization with respect to locally-linear time-varying models learned directly from sensor data. In some cases, we initialize the optimizer with human demonstrations collected via teleoperation in a virtual environment. We demonstrate that such controllers can perform the task robustly, both in simulation and on the physical platform, for a limited range of initial conditions around the trained starting state. We then consider two interpolation methods for generalizing to a wider range of initial conditions: deep learning, and nearest neighbors. We find that nearest neighbors achieve higher performance. Nevertheless, the neural network has its advantages: it uses only tactile and proprioceptive feedback but no visual feedback about the object (i.e. it performs the task blind) and learns a time-invariant policy. In contrast, the nearest neighbors method switches between time-varying local controllers based on the proximity of initial object states sensed via motion capture. While both generalization methods leave room for improvement, our work shows that (i) local trajectory-based controllers for complex non-prehensile manipulation tasks can be constructed from surprisingly small amounts of training data, and (ii) collections of such controllers can be interpolated to form more global controllers. Results are summarized in the supplementary video: https://youtu.be/E0wmO6deqjo

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑