arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.13860cs.CV
收藏

将结果引入自我注意力

Introduce the Result Into Self-Attention

Jilin University(吉林大学)

Chengcheng Ye

摘要:

传统的卷积网络自注意力机制倾向于只使用前一层的输出作为注意力网络的输入,如SENet、CBAM等。本文提出了一种新的注意力修改方法,尝试提前获取分类网络的输出,并将其作为注意力网络的一部分输入。我们使用GoogLeNet中提出的辅助分类器提前获得结果并将其传递到注意力网络中。我们将此机制添加到SE-ResNet中进行实验,并在cifar 100上实现了最多1.94%的分类准确率提高。

英文摘要:

Traditional self-attention mechanisms in convolutional networks tend to use only the output of the previous layer as input to the attention network, such as SENet, CBAM, etc. In this paper, we propose a new attention modification method that tries to get the output of the classification network in advance and use it as a part of the input of the attention network. We used the auxiliary classifier proposed in GoogLeNet to obtain the results in advance and pass them into attention networks. we added this mechanism to SE-ResNet for our experiments and achieved a classification accuracy improvement of at most 1.94% on cifar100.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑