arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1909.03834cs.LGcs.AIcs.CV
收藏

线性上下文变换块

Linear Context Transform Block

Qiushi Academy for Advanced Studies, Zhejiang University(浙江大学求是高等研究院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)

Dongsheng Ruan, Jun Wen, Nenggan Zheng, Min Zheng

摘要:

挤压和激励(SE)块提出了一种通道注意力机制,通过显式捕获跨通道的依赖关系来建模全局上下文。然而,我们仍然远远没有理解SE块是如何工作的。在这项工作中,我们首先重新审视SE块,然后提出了一个详细的全球背景和注意力分布之间的关系的实证研究,在此基础上,我们提出了一个简单而有效的模块,称为线性上下文变换(LCT)块。我们将所有通道分成不同的组,并在每个通道组内对全局聚合的上下文特征进行归一化,减少了不相关通道的干扰。通过对归一化的上下文特征进行线性变换,我们独立地为每个通道建模全局上下文。LCT块非常轻量级,易于插入到不同的骨干模型中,而参数和计算负担的增加可以忽略不计。大量的实验表明,LCT块在ImageNet上的图像分类任务和具有不同骨干模型的COCO数据集上的目标检测/分割中优于SE块。此外,LCT相对于现有的最先进的检测架构(例如,1.5 $\sim$ 1.7% AP $^{bbox}$和1.0 $\sim$ 1.2% AP $^{mask}$在COCO基准上的改进,而不考虑不同容量的不同基线模型。我们希望我们简单而有效的方法将有助于未来的研究基于注意力的模型。

英文摘要:

Squeeze-and-Excitation (SE) block presents a channel attention mechanism for modeling global context via explicitly capturing dependencies across channels. However, we are still far from understanding how the SE block works. In this work, we first revisit the SE block, and then present a detailed empirical study of the relationship between global context and attention distribution, based on which we propose a simple yet effective module, called Linear Context Transform (LCT) block. We divide all channels into different groups and normalize the globally aggregated context features within each channel group, reducing the disturbance from irrelevant channels. Through linear transform of the normalized context features, we model global context for each channel independently. The LCT block is extremely lightweight and easy to be plugged into different backbone models while with negligible parameters and computational burden increase. Extensive experiments show that the LCT block outperforms the SE block in image classification task on the ImageNet and object detection/segmentation on the COCO dataset with different backbone models. Moreover, LCT yields consistent performance gains over existing state-of-the-art detection architectures, e.g., 1.5$\sim$1.7% AP$^{bbox}$ and 1.0$\sim$1.2% AP$^{mask}$ improvements on the COCO benchmark, irrespective of different baseline models of varied capacities. We hope our simple yet effective approach will shed some light on future research of attention-based models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑