arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.05993cs.CV

用于医学图像超分辨率的自先验引导 Mamba-UNet 网络

Self-Prior Guided Mamba-UNet Networks for Medical Image Super-Resolution

School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University(中南大学机器视觉与智能医学湖南省工程研究中心);Department of Nuclear Medicine, Henri Becquerel Cancer Center(亨利·贝克勒尔癌症中心核医学科);University of Rouen-Normandy(鲁昂-诺曼底大学)

Zexin Ji, Beiji Zou, Xiaoyan Kui, Pierre Vera, Su Ruan

AI总结:

提出 SMamba-UNet,利用亮度修复扰动生成自先验,并结合 Mamba-UNet 与 ISS2D 多方向扫描,在 IXI 和 fastMRI 上实现优于现有方法的医学图像超分辨率。

摘要:

本文提出一种用于医学图像超分辨率的自先验引导 Mamba-UNet 网络(SMamba-UNet)。现有方法主要基于卷积神经网络(CNN)或 Transformer。基于 CNN 的方法无法捕捉长程依赖,而基于 Transformer 的方法由于具有二次计算复杂度,面临计算量沉重的挑战。近年来,状态空间模型(SSM),尤其是 Mamba,已经出现,能够以线性计算复杂度建模长程依赖。受 Mamba 启发,本文方法旨在在 Mamba-UNet 网络下学习自先验多尺度上下文特征,从而可能以高效方式对低分辨率医学图像进行超分辨率重建。具体而言,我们通过在网络训练期间扰动输入图像的亮度修复来获得自先验,这能够学习有利于超分辨率的详细纹理和亮度信息。此外,我们将 Mamba 与 UNet 网络相结合,以挖掘不同层级的全局特征。我们还设计了改进的二维选择性扫描(ISS2D)模块,将图像特征划分为不同方向的序列,以学习多个方向上的长程依赖,并自适应地融合序列信息,从而增强超分辨率特征表示。定性和定量实验结果均表明,我们的方法在两个公共医学数据集 IXI 和 fastMRI 上优于当前最先进的方法。

英文摘要:

In this paper, we propose a self-prior guided Mamba-UNet network (SMamba-UNet) for medical image super-resolution. Existing methods are primarily based on convolutional neural networks (CNNs) or Transformers. CNNs-based methods fail to capture long-range dependencies, while Transformer-based approaches face heavy calculation challenges due to their quadratic computational complexity. Recently, State Space Models (SSMs) especially Mamba have emerged, capable of modeling long-range dependencies with linear computational complexity. Inspired by Mamba, our approach aims to learn the self-prior multi-scale contextual features under Mamba-UNet networks, which may help to super-resolve low-resolution medical images in an efficient way. Specifically, we obtain self-priors by perturbing the brightness inpainting of the input image during network training, which can learn detailed texture and brightness information that is beneficial for super-resolution. Furthermore, we combine Mamba with Unet network to mine global features at different levels. We also design an improved 2D-Selective-Scan (ISS2D) module to divide image features into different directional sequences to learn long-range dependencies in multiple directions, and adaptively fuse sequence information to enhance super-resolved feature representation. Both qualitative and quantitative experimental results demonstrate that our approach outperforms current state-of-the-art methods on two public medical datasets: the IXI and fastMRI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑