In recent advancements in medical image analysis, Convolutional Neural Networks (CNN) and Vision Transformers (ViT) have set significant benchmarks. While the former excels in capturing local features through its convolution operations, the latter achieves remarkable global context understanding by leveraging self-attention mechanisms. However, both architectures exhibit limitations in efficiently modeling long-range dependencies within medical images, which is a critical aspect for precise segmentation. Inspired by the Mamba architecture, known for its proficiency in handling long sequences and global contextual information with enhanced computational efficiency as a State Space Model (SSM), we propose Mamba-UNet, a novel architecture that synergizes the U-Net in medical image segmentation with Mamba's capability. Mamba-UNet adopts a pure Visual Mamba (VMamba)-based encoder-decoder structure, infused with skip connections to preserve spatial information across different scales of the network. This design facilitates a comprehensive feature learning process, capturing intricate details and broader semantic contexts within medical images. We introduce a novel integration mechanism within the VMamba blocks to ensure seamless connectivity and information flow between the encoder and decoder paths, enhancing the segmentation performance. We conducted experiments on publicly available ACDC MRI Cardiac segmentation dataset, and Synapse CT Abdomen segmentation dataset. The results show that Mamba-UNet outperforms several types of UNet in medical image segmentation under the same hyper-parameter setting. The source code and baseline implementations are available.
xLSTM-UNet can be an Effective 2D & 3D Medical Image Segmentation Backbone with Vision-LSTM (ViL) better than its Mamba Counterpart
College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院）；KOKONI, Moxin (Huzhou) Tech. Co., LTD.（墨芯（湖州）科技有限公司KOKONI）；School of Information Engineering, Huzhou University（湖州师范学院信息工程学院）；Information Systems Technology and Design Pillar, Singapore University of Technology and Design（新加坡科技设计大学信息系统技术与设计 pillar）；School of Information Science and Technology, University of Science and Technology of China（中国科学技术大学信息科学技术学院）；School of Software Technology, Zhejiang University（浙江大学软件学院）
Self-Prior Guided Mamba-UNet Networks for Medical Image Super-Resolution
School of Computer Science and Engineering, Central South University（中南大学计算机科学与工程学院）；Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University（中南大学机器视觉与智能医学湖南省工程研究中心）；Department of Nuclear Medicine, Henri Becquerel Cancer Center（亨利·贝克勒尔癌症中心核医学科）；University of Rouen-Normandy（鲁昂-诺曼底大学）
MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation
Imperial College London（伦敦帝国学院）；Royal Brompton Hospital（皇家布朗普顿医院）；Nanjing University of Aeronautics and Astronautics（南京航空航天大学）；University of Cambridge（剑桥大学）
UNet with Self-Adaptive Mamba-Like Attention and Causal-Resonance Learning for Medical Image Segmentation
Faculty of Computing and IT (FCIT)（计算与信息技术学院）；Sohar University（索哈尔大学）；Department of Intelligent Systems（智能系统系）；KTH Royal Institute of Technology（皇家理工学院）；College of Computer and Information Sciences（计算机与信息科学学院）；Imam Mohammad Ibn Saud Islamic University (IMSIU)（伊玛目穆罕默德·本·沙特伊斯兰大学）；University of Auckland（奥克兰大学）；Department of Computer Science, Faculty of Science（科学学院计算机科学系）；Northern Border University（北方边境大学）
Fudan University（复旦大学）；Ruijin Hospital, Shanghai Jiaotong University（上海交通大学医学院附属瑞金医院）；Tongji Hospital, Huazhong University of Science and Technology（华中科技大学同济医学院附属同济医院）；Leiden University Medical Center（莱顿大学医学中心）
Convolutional neural network (CNN), in particular the Unet, is a powerful method for medical image segmentation. To date Unet has demonstrated state-of-art performance in many complex medical image segmentation tasks, especially under the condition when the training and testing data share the same distribution (i.e. come from the same source domain). However, in clinical practice, medical images are acquired from different vendors and centers. The performance of a U-Net trained from a particular source domain, when transferred to a different target domain (e.g. different vendor, acquisition pa…
The George Washington University Medical Center（乔治华盛顿大学医学中心）
Recently, deep learning has become much more popular in computer vision area. The Convolution Neural Network (CNN) has brought a breakthrough in images segmentation areas, especially, for medical images. In this regard, U-Net is the predominant approach to medical image segmentation task. The U-Net not only performs well in segmenting multimodal medical images generally, but also in some tough cases of them. However, we found that the classical U-Net architecture has limitation in several aspects. Therefore, we applied modifications: 1) designed efficient CNN architecture to replace encoder an…
Enhancing Global Sensitivity and Uncertainty Quantification in Medical Image Reconstruction with Monte Carlo Arbitrary-Masked Mamba
Imperial College London（帝国理工学院）；Royal Brompton Hospital（皇家布朗普顿医院）；College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics（南京航空航天大学计算机科学与技术学院）；School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University（中山大学深圳校区生物医学工程学院）；Human Phenome Institute, Fudan University（复旦大学人类表型组研究院）；Inselspital, University of Bern（伯尔尼大学因塞尔医院）；Technical University of Munich（慕尼黑工业大学）
I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling
Department of Electrical and Electronics Engineering, and National Magnetic Resonance Research Center, Bilkent University（电子工程系和国家磁共振研究中心，比尔肯特大学）；Department of Electrical Engineering, Stanford University（电气工程系，斯坦福大学）
MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registration
Image Processing Center, Beihang University, Beijing, China（北京航空航天大学图像处理中心）；Robotics Institute, Beihang University, Beijing, China（北京航空航天大学机器人研究所）；Tongji Hospital, Huazhong University of Science and Technology, Wuhan, China（华中科技大学同济医院）
Institute of Data Science, National University of Singapore（新加坡国立大学数据科学研究所）
The encoder-decoder model is a commonly used Deep Neural Network (DNN) model for medical image segmentation. Conventional encoder-decoder models make pixel-wise predictions focusing heavily on local patterns around the pixel. This makes it challenging to give segmentation that preserves the object's shape and topology, which often requires an understanding of the global context of the object. In this work, we propose a Fourier Coefficient Segmentation Network~(FCSN) -- a novel DNN-based model that segments an object by learning the complex Fourier coefficients of the object's masks. The Fourie…
Topology-Aware Wavelet Mamba for Airway Structure Segmentation in Postoperative Recurrent Nasopharyngeal Carcinoma CT Scans
School of Software Engineering, Sun Yat-sen University（中山大学软件工程学院）；School of Microelectronics, Shanghai University（上海大学微电子学院）；Electronic and Computer Engineering, The Hong Kong University of Science and Technology（香港科技大学电子与计算机工程系）；Ruijin Hospital, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属瑞金医院）；Eye & ENT Hospital, Fudan University（复旦大学附属眼耳鼻喉科医院）
LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation
School of Computer Science, Peking University（北京大学计算机学院）；Institute of Artificial Intelligence, Beihang University（北京航空航天大学人工智能研究院）；Key Laboratory of High Confidence Software Technologies, Ministry of Education（教育部高可信软件技术重点实验室）；National Engineering Research Center for Software Engineering, Peking University（北京大学国家软件工程研究中心）
In this paper, we present UNet++, a new, more powerful architecture for medical image segmentation. Our architecture is essentially a deeply-supervised encoder-decoder network where the encoder and decoder sub-networks are connected through a series of nested, dense skip pathways. The re-designed skip pathways aim at reducing the semantic gap between the feature maps of the encoder and decoder sub-networks. We argue that the optimizer would deal with an easier learning task when the feature maps from the decoder and encoder networks are semantically similar. We have evaluated UNet++ in compari…
Huazhong University of Science and Technology（华中科技大学）；Shenzhen University（深圳大学）
Deep convolutional neural network (CNN) achieves remarkable performance for medical image analysis. UNet is the primary source in the performance of 3D CNN architectures for medical imaging tasks, including brain tumor segmentation. The skip connection in the UNet architecture concatenates features from both encoder and decoder paths to extract multi-contextual information from image data. The multi-scaled features play an essential role in brain tumor segmentation. However, the limited use of features can degrade the performance of the UNet approach for segmentation. In this paper, we propose…
A Comprehensive Survey of Mamba Architectures for Medical Image Analysis: Classification, Segmentation, Restoration and Beyond
Indian Institute of Technology Indore, India；R.M.D. Engineering College, Kavaraipettai, India；Jio Platforms Limited, India；Birla Institute of Technology \& Science Pilani, India
MedMamba: Vision Mamba for Medical Image Classification
School of Biomedical Engineering（生物医学工程学院）；Guangzhou Medical University（广州医科大学）；School of Mathematics and Systems Science（数学与系统科学学院）；Guangdong Polytechnic Normal University（广东技术师范大学）
Global and Local Mamba Network for Multi-Modality Medical Image Super-Resolution
School of Computer Science and Engineering, Central South University（中南大学计算机科学与工程学院）；Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University（中南大学机器视觉与智能医学湖南省工程研究中心）；University of Rouen-Normandy（鲁昂-诺曼底大学）；Henri Becquerel Cancer Center（亨利·贝克勒尔癌症中心）
MambaMIM: Pre-training Mamba with State Space Token Interpolation and its Application to Medical Image Segmentation
School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China（科学技术大学生物医学工程学院）；Suzhou Institute for Advanced Research, University of Science and Technology of China（科学技术大学苏州市先进研究所）；Center for Medical Imaging, Robotics, and Analytic Computing & LEarning (MIRACLE), Suzhou Institute for Advanced Research, USTC（医学影像、机器人与分析计算与学习中心）；Department of Automation, Shanghai Jiao Tong University（上海交通大学自动化系）；Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University（上海交通大学图像处理与模式识别研究所）；Institute of Medical Robotics, Shanghai Jiao Tong University（上海交通大学医学机器人研究所）；State Key Laboratory of Precision and Intelligent Chemistry, University of Science and Technology of China（科学技术大学精密与智能化学国家重点实验室）
Mamba Based Feature Extraction And Adaptive Multilevel Feature Fusion For 3D Tumor Segmentation From Multi-modal Medical Image
School of Computer Science and Engineering, Central South University, Changsha, 410083, China（计算机科学与工程学院，中南大学，长沙，410083，中国）；Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University, Changsha, 410083, China（机器视觉与智能医学工程研究中心，中南大学，长沙，410083，中国）；Department of Radiation Oncology, Washington University in St. Louis, USA（放射肿瘤科，华盛顿大学圣路易斯分校，美国）；Department of Nuclear Medicine, Henri Becquerel Cancer Center, Rouen, France（核医学科，亨利·贝克勒尔癌症中心，鲁昂，法国）；University of Rouen-Normandy, AMIS - QuantIF UR 4108, F-76000, Rouen, France（鲁昂-诺曼底大学，AMIS - QuantIF UR 4108，法国，F-76000，鲁昂，法国）
VM-UNET-V2 Rethinking Vision Mamba UNet for Medical Image Segmentation
State Key Laboratory for Novel Software Technology, Nanjing University（南京大学计算机软件新技术国家重点实验室）；Huazhong University of Science and Technology（华中科技大学）；Jiangsu Province Hospital of Chinese Medicine（江苏省中医院）
HybridMamba: A Dual-domain Mamba for 3D Medical Image Segmentation
The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州））；Department of Radiology, Fudan University Shanghai Cancer Center（复旦大学上海肿瘤中心放射科）；Department of Oncology, Shanghai Medical College, Fudan University（复旦大学上海医学院肿瘤科）；The Hong Kong University of Science and Technology（香港科学与技术大学）
XFMamba: Cross-Fusion Mamba for Multi-View Medical Image Classification
Digital Environment Research Institute (DERI), Queen Mary University of London（伦敦大学玛丽女王学院数字环境研究所（DERI））；School of Electronic Engineering and Computer Science, Queen Mary University of London（伦敦大学玛丽女王学院电子工程与计算机科学学院）；Blizard Institute - Faculty of Medicine and Dentistry, Queen Mary University of London（伦敦大学玛丽女王学院医学与牙科学院布利扎德研究所）；University of Cambridge（剑桥大学）
VM-UNet: Vision Mamba UNet for Medical Image Segmentation
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University（上海交通大学电子信息与电气工程学院）；School of Biomedical Engineering, Shanghai Jiao Tong University（上海交通大学生物医学工程学院）
Vision Transformers (ViT)s have recently become popular due to their outstanding modeling capabilities, in particular for capturing long-range information, and scalability to dataset and model sizes which has led to state-of-the-art performance in various computer vision and medical image analysis tasks. In this work, we introduce a unified framework consisting of two architectures, dubbed UNetFormer, with a 3D Swin Transformer-based encoder and Convolutional Neural Network (CNN) and transformer-based decoders. In the proposed model, the encoder is linked to the decoder via skip connections at…
Attention-Mamba: A Mamba-Enhanced Multi-Scale Parallel Inference Network for Medical Image Segmentation
School of Astronautics, Northwestern Polytechnical University（航天学院，西北工业大学）；Department of Electronics and Telecommunications, Politecnico di Torino（电信系，托斯卡纳理工学院）；Beijing Aerospace Automatic Control Research Institute（北京航天自动控制研究所）；Xi'an University of Posts and Telecommunications（西安邮电大学）；Department of Oncology, University of Turin（肿瘤科，都灵大学）；Candiolo Cancer Institute, FPO-IRCCS（坎迪奥利癌症研究所，FPO-IRCCS）
Topo-VM-UNetV2: Encoding Topology into Vision Mamba UNet for Polyp Segmentation
Department of Computer Science, University of Texas Rio Grande Valley（德克萨斯理工大学里奥格兰德分校计算机科学系）；Department of Mathematical Sciences, The University of Texas at Dallas（德克萨斯大学达拉斯分校数学科学系）
FaRMamba: Frequency-based learning and Reconstruction aided Mamba for Medical Segmentation
School of Artificial Intelligence and Computer Science, Nantong University, China（人工智能与计算机科学学院，南通大学）；School of Information Science and Technology, Nantong University, China（信息科学与技术学院，南通大学）
Automatic extraction of liver and tumor from CT volumes is a challenging task due to their heterogeneous and diffusive shapes. Recently, 2D and 3D deep convolutional neural networks have become popular in medical image segmentation tasks because of the utilization of large labeled datasets to learn hierarchical features. However, 3D networks have some drawbacks due to their high cost on computational resources. In this paper, we propose a 3D hybrid residual attention-aware segmentation method, named RA-UNet, to precisely extract the liver volume of interests (VOI) and segment tumors from the l…
Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised learning framework with tailored proxy tasks for medical image analysis. Specifically, we propose: (i) a new 3D transformer-based model, dubbed Swin UNEt TRansformers (Swin UNETR), with a hierarchical encoder for self-supervised pre-training; (ii) tailored proxy tasks for learning the underlying pattern of human anatomy. We demonstrate successful pre-training of…
