MHITNet:一种用于医学ct图像分割的分层上下文注意力过滤器最小化网络
MHITNet: a minimize network with a hierarchical context-attentional filter for segmenting medical ct images
摘要:
在医学CT图像处理领域,卷积神经网络(CNN)一直是占主导地位的技术。编码器-解码器CNN利用局部性来提高效率,但它们不能正确地模拟远距离像素的相互作用。最近的研究表明,可以堆叠自注意或Transformer层来有效地学习长程依赖性。通过将图像块构建和处理为嵌入,Transformers已经应用于计算机视觉应用。然而,基于transformer的架构缺乏全局语义信息交互,并且需要大规模的训练数据集,这使得用小数据样本进行训练具有挑战性。为了解决这些挑战,我们提出了一个分层的上下文注意力Transformer网络(MHITNet),它结合了多尺度,Transformer,并在跳跃连接层次上下文提取模块。多尺度模块捕获更深的CT语义信息,使得Transformers能够更有效地将来自各个CNN阶段的标记化图片块的特征图编码为输入注意力序列。在三个数据集上进行的大量实验表明,本文提出的MHITNet算法优于目前最好的算法
英文摘要:
In the field of medical CT image processing, convolutional neural networks (CNNs) have been the dominant technique.Encoder-decoder CNNs utilise locality for efficiency, but they cannot simulate distant pixel interactions properly.Recent research indicates that self-attention or transformer layers can be stacked to efficiently learn long-range dependencies.By constructing and processing picture patches as embeddings, transformers have been applied to computer vision applications. However, transformer-based architectures lack global semantic information interaction and require a large-scale training dataset, making it challenging to train with small data samples. In order to solve these challenges, we present a hierarchical contextattention transformer network (MHITNet) that combines the multi-scale, transformer, and hierarchical context extraction modules in skip-connections. The multi-scale module captures deeper CT semantic information, enabling transformers to encode feature maps of tokenized picture patches from various CNN stages as input attention sequences more effectively. The hierarchical context attention module augments global data and reweights pixels to capture semantic context.Extensive trials on three datasets show that the proposed MHITNet beats current best practises
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。