arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.14464cs.CV

AttentNet:用于肺结节检测的全卷积3D注意力机制

AttentNet: Fully Convolutional 3D Attention for Lung Nodule Detection

Loughborough University(拉夫堡大学);Swansea University(斯旺西大学);Université de Toulon(土伦大学);Aix Marseille Univ(艾克斯-马赛大学);CNRS(法国国家科学研究中心);LIS(信息与系统实验室)

Majedaldein Almahasneh, Xianghua Xie, Adeline Paiement

AI总结:

针对3D医学影像中注意力机制计算开销大的问题,提出AttentNet框架,采用两个3D全卷积注意力模块,在LUNA-16数据集上验证其优于无注意力基线方法,用于肺结节检测。

摘要:

受注意力机制日益流行的启发,我们观察到流行的卷积注意力模型,如Squeeze-and-Excite(SE)和卷积块注意力模块(CBAM),依赖于昂贵的多层感知器(MLP)层。这些MLP层显著增加了计算复杂度,使得此类模型在数据维度和计算成本更高的3D图像场景中适用性降低。在3D医学影像(如3D肺部CT扫描)中,由于数据量大,高效处理至关重要。传统的2D注意力推广到3D会增加计算负担,从而产生了对更高效的3D任务注意力机制的需求。我们研究了在3D上下文中引入全卷积注意力的可能性。我们提出了两个3D全卷积注意力模块,并展示了它们在3D上下文中的有效性。利用肺部CT扫描进行3D肺结节检测,我们提出了AttentNet,一个从CT图像中自动检测肺结节的框架,将检测作为候选提议和假阳性(FP)减少两个阶段的集成。我们将所提出的3D注意力模块与推广到3D模块的流行2D卷积注意力方法以及自注意力单元进行了比较。对于FP减少阶段,我们还使用联合分析方法来聚合来自不同上下文级别的空间信息。我们使用LUNA-16肺结节检测数据集来证明所提出的全卷积注意力模块相对于不使用注意力时的基线流行肺结节检测方法的优势。我们的工作并非旨在实现肺结节检测任务中的最先进结果,而是展示在3D上下文中引入全卷积注意力的益处。

英文摘要:

Motivated by the increasing popularity of attention mechanisms, we observe that popular convolutional (conv.) attention models like Squeeze-and-Excite (SE) and Convolutional Block Attention Module (CBAM) rely on expensive multi-layer perception (MLP) layers. These MLP layers significantly increase computational complexity, making such models less applicable to 3D image contexts, where data dimensionality and computational costs are higher. In 3D medical imaging, such as 3D pulmonary CT scans, efficient processing is crucial due to the large data volume. Traditional 2D attention generalized to 3D increases the computational load, creating demand for more efficient attention mechanisms for 3D tasks. We investigate the possibility of incorporating fully convolutional (conv.) attention in 3D context. We present two 3D fully conv. attention blocks, demonstrating their effectiveness in 3D context. Using pulmonary CT scans for 3D lung nodule detection, we present AttentNet, an automated lung nodule detection framework from CT images, performing detection as an ensemble of two stages, candidate proposal and false positive (FP) reduction. We compare the proposed 3D attention blocks to popular 2D conv. attention methods generalized to 3D modules and to self-attention units. For the FP reduction stage, we also use a joint analysis approach to aggregate spatial information from different contextual levels. We use LUNA-16 lung nodule detection dataset to demonstrate the benefits of the proposed fully conv. attention blocks compared to baseline popular lung nodule detection methods when no attention is used. Our work does not aim at achieving state-of-the-art results in the lung nodule detection task, rather to demonstrate the benefits of incorporating fully conv. attention within a 3D context.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑