arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2411.09986cs.CVcs.AI
收藏

解锁面向开放世界少样本识别的迁移学习

Unlocking Transfer Learning for Open-World Few-Shot Recognition

Qualcomm AI Research(高通人工智能研究院)

Byeonggeun Kim, Juntae Lee, Kyuhong Shim, Simyung Chang

AI总结:

针对迁移学习无法适配开放世界少样本识别的问题,提出结合开放集感知元学习与无开放集迁移学习的两阶段方法及样本模拟策略,在两个基准上以极小训练开销取得SOTA性能。

摘要:

少样本开放集识别(FSOSR)针对一项关键的现实挑战,旨在将输入分类为已知类别(称为闭集类),同时识别不属于这些类别的开放集输入。尽管让模型适配给定少样本任务的迁移学习已成为闭集场景下的主流范式,但我们发现它无法拓展到开放世界场景。为破解这一难题,我们提出一种两阶段方法,由具备开放集感知的元学习与无开放集的迁移学习组成。在开放集感知元学习阶段,模型被训练以构建一个度量空间,为后续阶段提供有利的起点。在无开放集迁移学习阶段,模型通过迁移学习进一步适配特定的目标任务。此外,我们引入了一种通过修改训练数据集或生成伪开放集样本来模拟开放集样本的策略。该方法在两个广泛认可的基准数据集miniImageNet和tieredImageNet上取得了当前最优性能,仅增加了1.5%的训练开销。我们的工作证明了迁移学习在FSOSR中的有效性。

英文摘要:

Few-Shot Open-Set Recognition (FSOSR) targets a critical real-world challenge, aiming to categorize inputs into known categories, termed closed-set classes, while identifying open-set inputs that fall outside these classes. Although transfer learning where a model is tuned to a given few-shot task has become a prominent paradigm in closed-world, we observe that it fails to expand to open-world. To unlock this challenge, we propose a two-stage method which consists of open-set aware meta-learning with open-set free transfer learning. In the open-set aware meta-learning stage, a model is trained to establish a metric space that serves as a beneficial starting point for the subsequent stage. During the open-set free transfer learning stage, the model is further adapted to a specific target task through transfer learning. Additionally, we introduce a strategy to simulate open-set examples by modifying the training dataset or generating pseudo open-set examples. The proposed method achieves state-of-the-art performance on two widely recognized benchmarks, miniImageNet and tieredImageNet, with only a 1.5\% increase in training effort. Our work demonstrates the effectiveness of transfer learning in FSOSR.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑