arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.02018cs.CVcs.AI
收藏

TransDAE:用于高效医学图像分割的分层Transformer中的双重注意力机制

TransDAE: Dual Attention Mechanism in a Hierarchical Transformer for Efficient Medical Image Segmentation

South Dakota State University(南达科他州立大学);Technical and Vocational University (TVU)(技术与职业大学(TVU))

Bobby Azad, Pourya Adibfar, Kaiqun Fu

AI总结:

TransDAE提出一种分层Transformer双重注意力机制,同时建模空间与通道关联,并通过跨尺度交互模块增强跳跃连接,在Synaps多器官数据集上无需预训练权重即超越现有方法。

摘要:

在医疗保健领域,医学图像分割对于准确的疾病诊断和制定有效的治疗策略至关重要。早期检测可以显著帮助管理疾病并可能阻止其进展。机器学习,尤其是深度卷积神经网络,已成为应对分割挑战的一种有前景的方法。传统方法如U-Net使用编码块进行局部表示建模,并使用解码块来揭示语义关系。然而,这些模型通常难以处理在纹理和形状上表现出显著变化的多尺度对象,并且经常无法捕获输入数据中的长程依赖关系。为序列到序列预测设计的Transformer已被提出作为替代方案,利用全局自注意力机制。然而,由于粒度细节不足,它们有时可能缺乏精确定位能力。为了克服这些局限性,我们引入了TransDAE:一种新颖的方法,重新构想了自注意力机制,使其在整个特征空间中同时包含空间关联和通道关联,同时保持计算效率。此外,TransDAE通过跨尺度交互模块增强了跳跃连接路径,促进特征重用并提高定位精度。值得注意的是,TransDAE在Synaps多器官数据集上优于现有的最先进方法,即使不依赖预训练权重也是如此。

英文摘要:

In healthcare, medical image segmentation is crucial for accurate disease diagnosis and the development of effective treatment strategies. Early detection can significantly aid in managing diseases and potentially prevent their progression. Machine learning, particularly deep convolutional neural networks, has emerged as a promising approach to addressing segmentation challenges. Traditional methods like U-Net use encoding blocks for local representation modeling and decoding blocks to uncover semantic relationships. However, these models often struggle with multi-scale objects exhibiting significant variations in texture and shape, and they frequently fail to capture long-range dependencies in the input data. Transformers designed for sequence-to-sequence predictions have been proposed as alternatives, utilizing global self-attention mechanisms. Yet, they can sometimes lack precise localization due to insufficient granular details. To overcome these limitations, we introduce TransDAE: a novel approach that reimagines the self-attention mechanism to include both spatial and channel-wise associations across the entire feature space, while maintaining computational efficiency. Additionally, TransDAE enhances the skip connection pathway with an inter-scale interaction module, promoting feature reuse and improving localization accuracy. Remarkably, TransDAE outperforms existing state-of-the-art methods on the Synaps multi-organ dataset, even without relying on pre-trained weights.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑