arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.04192cs.CV
收藏

强化注意力,用于少样本学习及其他

Reinforced Attention for Few-Shot Learning and Beyond

Australian National University(澳大利亚国立大学);Data61-CSIRO(Data61-澳大利亚联邦科学与工业研究组织);EPFL(瑞士洛桑联邦理工学院);Monash University(莫纳什大学)

Jie Hong, Pengfei Fang, Weihao Li, Tong Zhang, Christian Simon, Mehrtash Harandi, Lars Petersson

摘要:

少样本学习的目标是在给定有限数量的支持样本的情况下,通常通过依赖于图像的全局嵌入来正确地识别来自未知类的查询样本。在本文中,我们提出了装备的骨干网络与注意力代理,这是由强化学习训练。策略梯度算法被用来训练智能体随着时间的推移自适应地定位特征图上的代表区域。我们进一步设计了一个奖励函数的基础上预测的保持出的数据,从而帮助注意力机制更好地推广到看不见的类。大量的实验表明,在强化注意力的帮助下,我们的嵌入网络有能力在少样本学习中逐步生成更具鉴别力的表示。此外,在图像分类任务上的实验也表明了该设计的有效性。

英文摘要:

Few-shot learning aims to correctly recognize query samples from unseen classes given a limited number of support samples, often by relying on global embeddings of images. In this paper, we propose to equip the backbone network with an attention agent, which is trained by reinforcement learning. The policy gradient algorithm is employed to train the agent towards adaptively localizing the representative regions on feature maps over time. We further design a reward function based on the prediction of the held-out data, thus helping the attention mechanism to generalize better across the unseen classes. The extensive experiments show, with the help of the reinforced attention, that our embedding network has the capability to progressively generate a more discriminative representation in few-shot learning. Moreover, experiments on the task of image classification also show the effectiveness of the proposed design.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑