arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.12694cs.RO
收藏

VP-GO:一个“轻”动作条件视觉预测模型

VP-GO: a "light" action-conditioned visual prediction model

Beijing Institute of Technology(北京理工大学);Inria(法国国家信息与自动化研究所);University of Lorraine(洛林大学);CNRS(法国国家科学研究中心)

Anji Ma, Yoann Fleytoux, Jean-Bapstiste Mouret, Serena Ivaldi

摘要:

视觉预测模型是一个很有前途的解决方案,基于视觉的机器人抓取杂乱,未知的软物体。以前的文献模型在计算上是贪婪的,这限制了可重复性;尽管有些人在预测模型中考虑了随机性,但它往往太弱,无法捕捉到涉及抓取此类物体的机器人实验的现实。此外,以前的工作集中在基本的动作,是没有效率的原因,在更复杂的语义动作。为了解决这些限制,我们提出了VP-GO,一个“轻”的随机动作条件视觉预测模型。我们提出了一个层次分解的语义抓取和操作动作到基本的末端执行器的运动,以确保与现有的模型和数据集的机器人动作,如RoboNet的视觉预测的兼容性。我们还记录并发布了一个新的开放数据集,用于对象抓取的视觉预测,称为PandaGrasp。我们的模型可以在RoboNet上进行预训练,并在PandaGrasp上进行微调,并且在信号预测指标方面与更复杂的模型类似。从质量上讲,它在预测我们的机器人执行复杂抓取的结果时表现出色。

英文摘要:

Visual prediction models are a promising solution for visual-based robotic grasping of cluttered, unknown soft objects. Previous models from the literature are computationally greedy, which limits reproducibility; although some consider stochasticity in the prediction model, it is often too weak to catch the reality of robotics experiments involving grasping such objects. Furthermore, previous work focused on elementary movements that are not efficient to reason in terms of more complex semantic actions. To address these limitations, we propose VP-GO, a ``light'' stochastic action-conditioned visual prediction model. We propose a hierarchical decomposition of semantic grasping and manipulation actions into elementary end-effector movements, to ensure compatibility with existing models and datasets for visual prediction of robotic actions such as RoboNet. We also record and release a new open dataset for visual prediction of object grasping, called PandaGrasp. Our model can be pre-trained on RoboNet and fine-tuned on PandaGrasp, and performs similarly to more complex models in terms of signal prediction metrics. Qualitatively, it outperforms when predicting the outcome of complex grasps performed by our robot.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑