arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.04722eess.IVcs.CVcs.LG
收藏

U-Mamba:增强生物医学图像分割的长距离依赖

U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation

Peter Munk Cardiac Centre, University Health Network(彼得·蒙克心脏中心,大学健康网络);University of Toronto(多伦多大学);Vector Institute for Artificial Intelligence(向量人工智能研究所)

Jun Ma, Feifei Li, Bo Wang

AI总结:

针对生物医学图像分割中CNN和Transformer处理长距离依赖受限的问题,提出通用网络U-Mamba,通过混合CNN-SSM块结合局部特征提取与长距离依赖捕获能力,并具备自配置机制,在四项任务中均优于现有最先进方法。

摘要:

卷积神经网络(CNNs)和Transformers一直是生物医学图像分割最受欢迎的架构,但由于固有的局部性或计算复杂性,它们在处理长距离依赖方面的能力都有限。为了应对这一挑战,我们引入了U-Mamba,一种用于生物医学图像分割的通用网络。受State Space Sequence Models(SSMs)启发,这是一种以处理长序列的强大能力而闻名的深度序列模型新家族,我们设计了一个混合CNN-SSM块,将卷积层的局部特征提取能力与SSMs捕获长距离依赖的能力相结合。此外,U-Mamba具有自配置机制,使其能够无需人工干预即可自动适应各种数据集。我们在四项不同的任务上进行了广泛实验,包括CT和MR图像中的3D腹部器官分割、内窥镜图像中的器械分割以及显微镜图像中的细胞分割。结果显示,U-Mamba在所有任务中均优于基于CNN和基于Transformer的最先进分割网络。这为生物医学图像分析中的高效长距离依赖建模开辟了新途径。代码、模型和数据已在https://wanglab.ai/u-mamba.html公开提供。

英文摘要:

Convolutional Neural Networks (CNNs) and Transformers have been the most popular architectures for biomedical image segmentation, but both of them have limited ability to handle long-range dependencies because of inherent locality or computational complexity. To address this challenge, we introduce U-Mamba, a general-purpose network for biomedical image segmentation. Inspired by the State Space Sequence Models (SSMs), a new family of deep sequence models known for their strong capability in handling long sequences, we design a hybrid CNN-SSM block that integrates the local feature extraction power of convolutional layers with the abilities of SSMs for capturing the long-range dependency. Moreover, U-Mamba enjoys a self-configuring mechanism, allowing it to automatically adapt to various datasets without manual intervention. We conduct extensive experiments on four diverse tasks, including the 3D abdominal organ segmentation in CT and MR images, instrument segmentation in endoscopy images, and cell segmentation in microscopy images. The results reveal that U-Mamba outperforms state-of-the-art CNN-based and Transformer-based segmentation networks across all tasks. This opens new avenues for efficient long-range dependency modeling in biomedical image analysis. The code, models, and data are publicly available at https://wanglab.ai/u-mamba.html.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑