arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.11051cs.CV

用于参数与计算高效的超细粒度图像识别的下采样层间适配器

Down-Sampling Inter-Layer Adapter for Parameter and Computation Efficient Ultra-Fine-Grained Image Recognition

National Yang Ming Chiao Tung University(国立阳明交通大学);Cohere For AI Community(Cohere AI社区);National Tsing Hua University(国立清华大学)

Edwin Arkel Rios, Femiloye Oyerinde, Min-Chun Hu, Bo-Cheng Lai

AI总结:

针对超细粒度图像识别样本稀缺、任务难度大的问题,提出带双分支下采样的层间适配器参数高效微调方法,在10个数据集上实现精度提升与参数量、运算量的大幅降低。

摘要:

超细粒度图像识别(Ultra-fine-grained image recognition,UFGIR)旨在对类别间差异极小的对象进行分类,例如区分同一物种内的不同栽培品种,这与细粒度图像识别(fine-grained image recognition,FGIR)中的物种级分类不同。由于每个类别的样本稀缺,该任务的难度进一步加剧。为应对这些挑战,我们提出了一种在参数高效设置下采用下采样层间适配器的新方法:该方法冻结主干网络参数,仅微调少量额外模块。通过整合双分支下采样,我们大幅减少了所需的参数量和浮点运算量(FLOPs),使方法具备极高的效率。在10个数据集上开展的综合实验表明,我们的方法取得了出色的精度-成本综合性能,凸显了其在资源受限环境下实际应用的潜力。具体而言,在参数高效设置下,我们的方法相比其他方法平均精度至少提升6.8%;同时,与当前最先进的UFGIR方法相比,其可训练参数量至少减少123倍,且FLOPs相比其他方法平均降低30%。

英文摘要:

Ultra-fine-grained image recognition (UFGIR) categorizes objects with extremely small differences between classes, such as distinguishing between cultivars within the same species, as opposed to species-level classification in fine-grained image recognition (FGIR). The difficulty of this task is exacerbated due to the scarcity of samples per category. To tackle these challenges we introduce a novel approach employing down-sampling inter-layer adapters in a parameter-efficient setting, where the backbone parameters are frozen and we only fine-tune a small set of additional modules. By integrating dual-branch down-sampling, we significantly reduce the number of parameters and floating-point operations (FLOPs) required, making our method highly efficient. Comprehensive experiments on ten datasets demonstrate that our approach obtains outstanding accuracy-cost performance, highlighting its potential for practical applications in resource-constrained environments. In particular, our method increases the average accuracy by at least 6.8\% compared to other methods in the parameter-efficient setting while requiring at least 123x less trainable parameters compared to current state-of-the-art UFGIR methods and reducing the FLOPs by 30\% in average compared to other methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑