arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.12152cs.CV
收藏

Few-Shot目标检测的双重感知注意

Dual-Awareness Attention for Few-Shot Object Detection

National Taiwan University(台湾大学);Mobile Drive Technology(Mobile Drive Technology(移动驱动科技))

Tung-I Chen, Yueh-Cheng Liu, Hung-Ting Su, Yu-Cheng Chang, Yu-Hsiang Lin, Jia-Fong Yeh, Wen-Chin Chen, Winston H. Hsu

摘要:

虽然最近的进展显着提高了Few-Shot分类(FSC)的性能,Few-Shot目标检测(FSOD)仍然是现代学习系统的挑战。现有的FSOD系统遵循FSC方法,忽略了空间变化和不确定表示等关键问题,因此导致性能低下。观察到这一点,我们提出了一种新的\textbf{Dual-Awareness Attention (DAnA)}机制,使网络能够自适应地解释给定的支持图像。DAnA将支持图像转换为\textbf{query-position-aware}(QPA)特征,通过将定制的支持信息分配给查询的每个局部区域来精确地引导检测网络。此外,所提出的DAnA组件是灵活的,并适用于多种现有的目标检测框架。通过采用DAnA,传统的目标检测网络、Faster R-CNN和RetinaNet(并非明确针对少样本学习而设计)在FSOD任务中达到了最先进的性能。与以前的方法相比,我们的模型显着提高了47%(+6.9 AP)的性能,在各种评估设置下显示出显着的能力。

英文摘要:

While recent progress has significantly boosted few-shot classification (FSC) performance, few-shot object detection (FSOD) remains challenging for modern learning systems. Existing FSOD systems follow FSC approaches, ignoring critical issues such as spatial variability and uncertain representations, and consequently result in low performance. Observing this, we propose a novel \textbf{Dual-Awareness Attention (DAnA)} mechanism that enables networks to adaptively interpret the given support images. DAnA transforms support images into \textbf{query-position-aware} (QPA) features, guiding detection networks precisely by assigning customized support information to each local region of the query. In addition, the proposed DAnA component is flexible and adaptable to multiple existing object detection frameworks. By adopting DAnA, conventional object detection networks, Faster R-CNN and RetinaNet, which are not designed explicitly for few-shot learning, reach state-of-the-art performance in FSOD tasks. In comparison with previous methods, our model significantly increases the performance by 47\% (+6.9 AP), showing remarkable ability under various evaluation settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑