在物体堆操作中视觉模糊线性模型的惊人效果
The Surprising Effectiveness of Linear Models for Visual Foresight in Object Pile Manipulation
摘要:
在本文中,我们解决的问题,推动桩的小物体到一个所需的目标集,使用视觉反馈。与传统的单对象操纵管道不同,传统的单对象操纵管道估计由姿态参数化的系统的状态,该系统的底层物理状态难以从图像中观察到。因此,我们采取直接在图像空间中推理的方法,并获得视觉测量的动态,以合成视觉反馈策略。我们使用图像空间李雅普诺夫函数提出了一个简单的控制器,并使用三种不同类型的图像预测模型来评估闭环性能:基于深度学习的图像到图像转换模型,将每个像素视为粒子的以对象为中心的模型,以及使用动作相关线性映射的切换线性系统。通过模拟和实验的结果,我们表明,对于这项任务,线性模型的效果令人惊讶地好-与我们在相同数据量上训练的深度模型相比,实现了更好的预测误差,下游任务性能和对新环境的泛化。我们相信,这些结果提供了一个有趣的例子,在光谱的模型,是最有用的基于视觉的反馈操作,考虑到视觉预测的质量,以及与严格的控制设计和分析方法的兼容性。项目网址:https://sites.google.com/view/linear-visual-foresight/home
英文摘要:
In this paper, we tackle the problem of pushing piles of small objects into a desired target set using visual feedback. Unlike conventional single-object manipulation pipelines, which estimate the state of the system parametrized by pose, the underlying physical state of this system is difficult to observe from images. Thus, we take the approach of reasoning directly in the space of images, and acquire the dynamics of visual measurements in order to synthesize a visual-feedback policy. We present a simple controller using an image-space Lyapunov function, and evaluate the closed-loop performance using three different class of models for image prediction: deep-learning-based models for image-to-image translation, an object-centric model obtained from treating each pixel as a particle, and a switched-linear system where an action-dependent linear map is used. Through results in simulation and experiment, we show that for this task, a linear model works surprisingly well -- achieving better prediction error, downstream task performance, and generalization to new environments than the deep models we trained on the same amount of data. We believe these results provide an interesting example in the spectrum of models that are most useful for vision-based feedback in manipulation, considering both the quality of visual prediction, as well as compatibility with rigorous methods for control design and analysis. Project site: https://sites.google.com/view/linear-visual-foresight/home
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。