arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.07332cs.CVcs.AI

LKM-UNet:用于医学图像分割的大核视觉Mamba UNet

LKM-UNet: Large Kernel Vision Mamba UNet for Medical Image Segmentation

College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Institute of Wenzhou, Zhejiang University(浙江大学温州研究院);The Second Affiliated Hospital, Zhejiang University School of Medicine(浙江大学医学院附属第二医院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Notre Dame(圣母大学)

Jinhong Wang, Jintai Chen, Danny Chen, Jian Wu

AI总结:

提出LKM-UNet,通过大核Mamba与分层双向模块兼顾局部与全局空间建模,解决医学图像分割中感受野受限与长距离建模成本高的问题。

摘要:

在临床实践中,医学图像分割提供了关于目标器官或组织轮廓和尺寸的有用信息,有助于改善诊断、分析和治疗。在过去几年中,卷积神经网络(CNNs)和Transformers主导了该领域,但它们仍然面临感受野有限或长距离建模成本高昂的问题。Mamba作为一种状态空间序列模型(SSM),最近作为一种具有线性复杂度的长距离依赖建模的有前途的范式出现。在本文中,我们引入了一种大核视觉Mamba U型网络,或称LKM-UNet,用于医学图像分割。我们的LKM-UNet的一个显著特征是利用大型Mamba核,与基于小核的CNNs和Transformers相比,在局部空间建模方面表现出色,同时与具有二次复杂度的自注意力机制相比,在全局建模方面保持了卓越的效率。此外,我们设计了一个新颖的分层双向Mamba块,以进一步增强Mamba对视觉输入的全局和邻域空间建模能力。综合实验证明了使用大尺寸Mamba核实现大感受野的可行性和有效性。代码可在https://github.com/wjh892521292/LKM-UNet获取。

英文摘要:

In clinical practice, medical image segmentation provides useful information on the contours and dimensions of target organs or tissues, facilitating improved diagnosis, analysis, and treatment. In the past few years, convolutional neural networks (CNNs) and Transformers have dominated this area, but they still suffer from either limited receptive fields or costly long-range modeling. Mamba, a State Space Sequence Model (SSM), recently emerged as a promising paradigm for long-range dependency modeling with linear complexity. In this paper, we introduce a Large Kernel Vision Mamba U-shape Network, or LKM-UNet, for medical image segmentation. A distinguishing feature of our LKM-UNet is its utilization of large Mamba kernels, excelling in locally spatial modeling compared to small kernel-based CNNs and Transformers, while maintaining superior efficiency in global modeling compared to self-attention with quadratic complexity. Additionally, we design a novel hierarchical and bidirectional Mamba block to further enhance Mamba's global and neighborhood spatial modeling capability for vision inputs. Comprehensive experiments demonstrate the feasibility and the effectiveness of using large-size Mamba kernels to achieve large receptive fields. Codes are available at https://github.com/wjh892521292/LKM-UNet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑