arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.09046cs.ROcs.AIcs.CVcs.LG
收藏

用于表示学习的有趣交互

Playful Interactions for Representation Learning

UC Berkeley(加州大学伯克利分校);NYU(纽约大学)

Sarah Young, Jyothish Pari, Pieter Abbeel, Lerrel Pinto

摘要:

视觉模仿学习的关键挑战之一是为给定的任务收集大量的专家演示。虽然收集人类演示的方法随着遥操作方法和低成本辅助工具的使用变得越来越容易,但我们通常仍然需要为每个任务进行100-1000次演示才能学习视觉表示和策略。为了解决这个问题,我们转向另一种不需要特定任务演示的数据形式--游戏。游戏是儿童在早期学习中学习一系列技能、行为和视觉表征的基本方法。重要的是,游戏数据是多样的,任务不可知的,并且获得相对便宜。在这项工作中,我们建议以自我监督的方式使用有趣的交互来学习下游任务的视觉表示。我们在19个不同的环境中收集了2个小时的有趣数据,并使用自我预测学习来提取视觉表征。给定这些表示,我们使用模仿学习为两个下游任务训练策略:推和堆叠。我们证明,我们的视觉表示概括优于标准的行为克隆,可以实现类似的性能,只有一半的数量所需的演示。我们的表示是从头开始训练的,与ImageNet预训练的表示相比毫不逊色。最后,我们提供了一个实验分析不同的预训练模式对下游任务学习的影响。

英文摘要:

One of the key challenges in visual imitation learning is collecting large amounts of expert demonstrations for a given task. While methods for collecting human demonstrations are becoming easier with teleoperation methods and the use of low-cost assistive tools, we often still require 100-1000 demonstrations for every task to learn a visual representation and policy. To address this, we turn to an alternate form of data that does not require task-specific demonstrations -- play. Playing is a fundamental method children use to learn a set of skills and behaviors and visual representations in early learning. Importantly, play data is diverse, task-agnostic, and relatively cheap to obtain. In this work, we propose to use playful interactions in a self-supervised manner to learn visual representations for downstream tasks. We collect 2 hours of playful data in 19 diverse environments and use self-predictive learning to extract visual representations. Given these representations, we train policies using imitation learning for two downstream tasks: Pushing and Stacking. We demonstrate that our visual representations generalize better than standard behavior cloning and can achieve similar performance with only half the number of required demonstrations. Our representations, which are trained from scratch, compare favorably against ImageNet pretrained representations. Finally, we provide an experimental analysis on the effects of different pretraining modes on downstream task learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑