arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.04992cs.CV
收藏

学习跨领域和模态观察

Learning to see across Domains and Modalities

Sapienza - University of Rome(罗马第一大学)

Fabio Maria Carlucci

摘要:

深度学习作为许多应用程序的通用解决方案,带来了希望和期望;事实证明,它确实有效,但它也显示出对大量数据的强烈依赖。幸运的是,即使在数据稀缺的情况下,也可以通过重用先验知识来训练成功的模型。因此,开发迁移学习的技术,在其最广泛的定义中,是部署有效和准确的智能系统的关键因素。本论文将集中于一系列的迁移学习方法应用于视觉对象识别的任务,特别是图像分类。迁移学习是一个通用术语,特定的设置被赋予了特定的名称:当学习者只能访问来自目标域的未标记数据和来自不同域(源)的标记数据时,该问题被称为“无监督领域自适应“(DA)。本工作的第一部分将集中在此设置的三种方法:其中一种方法处理特征,一种方法处理图像,而第三种方法同时使用两者。第二部分将专注于机器人感知的现实问题,特别是RGB-D识别。机器人平台通常不限于颜色感知;它们通常还携带深度相机。不幸的是,深度模态很少用于视觉识别,这是因为缺乏可供传输的预训练模型,并且几乎没有数据可以从头开始训练。将提出两种处理这种情况的方法:一种是使用合成数据,另一种是利用跨模态迁移学习。

英文摘要:

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data is scarce, a successful model can be trained by reusing prior knowledge. Thus, developing techniques for transfer learning, in its broadest definition, is a crucial element towards the deployment of effective and accurate intelligent systems. This thesis will focus on a family of transfer learning methods applied to the task of visual object recognition, specifically image classification. Transfer learning is a general term, and specific settings have been given specific names: when the learner has only access to unlabeled data from the a target domain and labeled data from a different domain (the source), the problem is known as that of "unsupervised domain adaptation" (DA). The first part of this work will focus on three methods for this setting: one of these methods deals with features, one with images while the third one uses both. The second part will focus on the real life issues of robotic perception, specifically RGB-D recognition. Robotic platforms are usually not limited to color perception; very often they also carry a Depth camera. Unfortunately, the depth modality is rarely used for visual recognition due to the lack of pretrained models from which to transfer and little data to train one on from scratch. Two methods for dealing with this scenario will be presented: one using synthetic data and the other exploiting cross-modality transfer learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑