arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.06372cs.CVcs.AIcs.LG
收藏

基于单纯形的单次视觉分类任务消歧

Disambiguation of One-Shot Visual Classification Tasks: A Simplex-Based Approach

IMT Atlantique(大西洋国立高等工业技术与矿业学校);Lab-STICC(法国国家科学研究中心6285联合研究实验室(STICC实验室));CNRS(法国国家科学研究中心)

Yassir Bendou, Lucas Drumetz, Vincent Gripon, Giulia Lioi, Bastien Pasdeloup

摘要:

视觉Few-Shot分类领域旨在将深度学习视觉系统的最新性能转移到只有非常有限数量的训练样本可用的任务上。主要的解决方案包括训练一个特征提取器,使用一个大的和不同的数据集被应用到所考虑的Few-Shot任务。由于特征提取器中的编码先验,即使镜头显示不代表其类别的个体特征,每个类别的分类任务也可以高精度地解决,其中每个类别只有一个示例(或“镜头”)。然而,当一些给定的镜头显示多个对象时,问题变得更加复杂。在本文中,我们提出了一种策略,旨在检测在一个给定的镜头中的多个和以前看不见的对象的存在。这种方法是基于确定的角落的一个单纯形在一个高维空间。我们介绍了一个优化例程,并展示了它成功检测原始图像中多个(以前看不见的)对象的能力。然后,我们引入了一个下游分类器,旨在利用多个对象的存在,以提高性能的Few-Shot分类,在极端设置的情况下,只有一个镜头是给它的类。使用该领域的标准基准,我们展示了所提出的方法在这些设置中略微提高准确性的能力,但在统计上显着。

英文摘要:

The field of visual few-shot classification aims at transferring the state-of-the-art performance of deep learning visual systems onto tasks where only a very limited number of training samples are available. The main solution consists in training a feature extractor using a large and diverse dataset to be applied to the considered few-shot task. Thanks to the encoded priors in the feature extractors, classification tasks with as little as one example (or "shot'') for each class can be solved with high accuracy, even when the shots display individual features not representative of their classes. Yet, the problem becomes more complicated when some of the given shots display multiple objects. In this paper, we present a strategy which aims at detecting the presence of multiple and previously unseen objects in a given shot. This methodology is based on identifying the corners of a simplex in a high dimensional space. We introduce an optimization routine and showcase its ability to successfully detect multiple (previously unseen) objects in raw images. Then, we introduce a downstream classifier meant to exploit the presence of multiple objects to improve the performance of few-shot classification, in the case of extreme settings where only one shot is given for its class. Using standard benchmarks of the field, we show the ability of the proposed method to slightly, yet statistically significantly, improve accuracy in these settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑