arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.03034cs.CV
收藏

不是所有的类都有相同的贡献:用于Few-Shot视觉识别的实例自适应类表示学习

Not All Instances Contribute Equally: Instance-adaptive Class Representation Learning for Few-Shot Visual Recognition

Wuhan University(武汉大学);Hubei Luojia Laboratory(湖北珞珈实验室);JD Explore Academy(京东探索研究院);Beijing Institute of Technology(北京理工大学);Nanyang Technological University(南洋理工大学)

Mengya Han, Yibing Zhan, Yong Luo, Bo Du, Han Hu, Yonggang Wen, Dacheng Tao

摘要:

Few-Shot视觉识别是指从少量标记实例中识别新的视觉概念。许多Few-Shot视觉识别方法采用基于度量的元学习范式,通过比较查询表示和类表示来预测查询实例的类别。然而,目前的基于度量的方法通常平等地对待所有实例,因此经常获得有偏见的类表示,考虑到不是所有的实例都同样重要时,总结类级表示的实例级表示。例如,某些实例可能包含不具有代表性的信息,例如太多的背景和不相关概念的信息,这会扭曲结果。为了解决上述问题,我们提出了一种新的基于度量的元学习框架称为实例自适应类表示学习网络(ICRL-Net)的Few-Shot视觉识别。具体来说,我们开发了一个自适应的实例重估网络的能力,以解决有偏见的代表性问题时,产生的类表示,通过学习和分配自适应的权重为不同的实例,根据其相对重要性在相应的类的支持集。此外,我们设计了一个改进的双线性实例表示,并纳入两个新的结构损失,即,类内实例聚类损失和类间表示区分损失,以进一步规范实例重估过程,细化类表示。我们对四个常用的Few-Shot基准测试进行了广泛的实验:miniImageNet,tieredImageNet,CIFAR-FS和FC 100数据集。实验结果表明,我们的ICRL-Net与国家的最先进的方法相比的优越性。

英文摘要:

Few-shot visual recognition refers to recognize novel visual concepts from a few labeled instances. Many few-shot visual recognition methods adopt the metric-based meta-learning paradigm by comparing the query representation with class representations to predict the category of query instance. However, current metric-based methods generally treat all instances equally and consequently often obtain biased class representation, considering not all instances are equally significant when summarizing the instance-level representations for the class-level representation. For example, some instances may contain unrepresentative information, such as too much background and information of unrelated concepts, which skew the results. To address the above issues, we propose a novel metric-based meta-learning framework termed instance-adaptive class representation learning network (ICRL-Net) for few-shot visual recognition. Specifically, we develop an adaptive instance revaluing network with the capability to address the biased representation issue when generating the class representation, by learning and assigning adaptive weights for different instances according to their relative significance in the support set of corresponding class. Additionally, we design an improved bilinear instance representation and incorporate two novel structural losses, i.e., intra-class instance clustering loss and inter-class representation distinguishing loss, to further regulate the instance revaluation process and refine the class representation. We conduct extensive experiments on four commonly adopted few-shot benchmarks: miniImageNet, tieredImageNet, CIFAR-FS, and FC100 datasets. The experimental results compared with the state-of-the-art approaches demonstrate the superiority of our ICRL-Net.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑