arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.02840cs.CV
收藏

CIM:用于Few-Shot分类的类无关映射

CIM: Class-Irrelevant Mapping for Few-Shot Classification

China University of Petroleum (East China)(中国石油大学(华东));BIOMIND;University of Macau(澳门大学)

Shuai Shao, Lei Xing, Yixin Chen, Yan-Jiang Wang, Bao-Di Liu, Yicong Zhou

摘要:

Few-Shot分类是近年来研究的热点问题之一。一般设置包括两个阶段:(1)用基础数据(具有大量标记样本)预训练特征提取模型(FEM)。(2)利用有限单元法对新数据(标记样本少、类别与基础数据完全不同的数据)进行特征提取,然后用待设计的分类器进行分类。预训练的FEM对新数据的适应性决定了新特征的准确性,从而影响最终的分类性能。因此,如何评估预先训练好的有限元模型是目前FSC界最关注的问题。这听起来像是传统的基于类激活映射(CAM)的方法可以通过叠加加权特征映射来实现这一点。然而,由于FSC的特殊性(例如,当使用预训练的FEM提取新特征时没有反向传播),我们不能用新类激活特征图。为了解决这个问题,我们提出了一个简单,灵活的方法,被称为类无关映射(CIM)。具体来说,首先,我们引入字典学习理论,并将特征映射的通道视为字典中的基础。然后利用特征图拟合图像的特征向量,得到相应的通道权值。最后,我们重叠加权特征图进行可视化,以评估预训练的FEM对新数据的能力。为了公平地使用CIM评估不同的模型,我们提出了一个新的测量指标,称为特征定位精度(FLA)。在实验中,我们首先比较了我们的CIM与CAM在常规任务,并取得了出色的表现。接下来,我们使用我们的CIM来评估几个经典的FSC框架,而不考虑分类结果,并讨论它们。

英文摘要:

Few-shot classification (FSC) is one of the most concerned hot issues in recent years. The general setting consists of two phases: (1) Pre-train a feature extraction model (FEM) with base data (has large amounts of labeled samples). (2) Use the FEM to extract the features of novel data (with few labeled samples and totally different categories from base data), then classify them with the to-be-designed classifier. The adaptability of pre-trained FEM to novel data determines the accuracy of novel features, thereby affecting the final classification performances. To this end, how to appraise the pre-trained FEM is the most crucial focus in the FSC community. It sounds like traditional Class Activate Mapping (CAM) based methods can achieve this by overlaying weighted feature maps. However, due to the particularity of FSC (e.g., there is no backpropagation when using the pre-trained FEM to extract novel features), we cannot activate the feature map with the novel classes. To address this challenge, we propose a simple, flexible method, dubbed as Class-Irrelevant Mapping (CIM). Specifically, first, we introduce dictionary learning theory and view the channels of the feature map as the bases in a dictionary. Then we utilize the feature map to fit the feature vector of an image to achieve the corresponding channel weights. Finally, we overlap the weighted feature map for visualization to appraise the ability of pre-trained FEM on novel data. For fair use of CIM in evaluating different models, we propose a new measurement index, called Feature Localization Accuracy (FLA). In experiments, we first compare our CIM with CAM in regular tasks and achieve outstanding performances. Next, we use our CIM to appraise several classical FSC frameworks without considering the classification results and discuss them.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑