Self-Prior Guided Mamba-UNet Networks for Medical Image Super-Resolution
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University(中南大学机器视觉与智能医学湖南省工程研究中心);Department of Nuclear Medicine, Henri Becquerel Cancer Center(亨利·贝克勒尔癌症中心核医学科);University of Rouen-Normandy(鲁昂-诺曼底大学)
Zexin Ji, Beiji Zou, Xiaoyan Kui, Pierre Vera, Su Ruan
In this paper, we propose a self-prior guided Mamba-UNet network (SMamba-UNet) for medical image super-resolution. Existing methods are primarily based on convolutional neural networks (CNNs) or Transformers. CNNs-based methods fail to capture long-range dependencies, while Transformer-based approaches face heavy calculation challenges due to their quadratic computational complexity. Recently, State Space Models (SSMs) especially Mamba have emerged, capable of modeling long-range dependencies with linear computational complexity. Inspired by Mamba, our approach aims to learn the self-prior multi-scale contextual features under Mamba-UNet networks, which may help to super-resolve low-resolution medical images in an efficient way. Specifically, we obtain self-priors by perturbing the brightness inpainting of the input image during network training, which can learn detailed texture and brightness information that is beneficial for super-resolution. Furthermore, we combine Mamba with Unet network to mine global features at different levels. We also design an improved 2D-Selective-Scan (ISS2D) module to divide image features into different directional sequences to learn long-range dependencies in multiple directions, and adaptively fuse sequence information to enhance super-resolved feature representation. Both qualitative and quantitative experimental results demonstrate that our approach outperforms current state-of-the-art methods on two public medical datasets: the IXI and fastMRI.
MambaMorph: a Mamba-based Framework for Medical MR-CT Deformable Registration
Image Processing Center, Beihang University, Beijing, China(北京航空航天大学图像处理中心);Robotics Institute, Beihang University, Beijing, China(北京航空航天大学机器人研究所);Tongji Hospital, Huazhong University of Science and Technology, Wuhan, China(华中科技大学同济医院)
xLSTM-UNet can be an Effective 2D & 3D Medical Image Segmentation Backbone with Vision-LSTM (ViL) better than its Mamba Counterpart
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);KOKONI, Moxin (Huzhou) Tech. Co., LTD.(墨芯(湖州)科技有限公司KOKONI);School of Information Engineering, Huzhou University(湖州师范学院信息工程学院);Information Systems Technology and Design Pillar, Singapore University of Technology and Design(新加坡科技设计大学信息系统技术与设计 pillar);School of Information Science and Technology, University of Science and Technology of China(中国科学技术大学信息科学技术学院);School of Software Technology, Zhejiang University(浙江大学软件学院)
Global and Local Mamba Network for Multi-Modality Medical Image Super-Resolution
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University(中南大学机器视觉与智能医学湖南省工程研究中心);University of Rouen-Normandy(鲁昂-诺曼底大学);Henri Becquerel Cancer Center(亨利·贝克勒尔癌症中心)
MambaMIM: Pre-training Mamba with State Space Token Interpolation and its Application to Medical Image Segmentation
School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China(科学技术大学生物医学工程学院);Suzhou Institute for Advanced Research, University of Science and Technology of China(科学技术大学苏州市先进研究所);Center for Medical Imaging, Robotics, and Analytic Computing & LEarning (MIRACLE), Suzhou Institute for Advanced Research, USTC(医学影像、机器人与分析计算与学习中心);Department of Automation, Shanghai Jiao Tong University(上海交通大学自动化系);Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University(上海交通大学图像处理与模式识别研究所);Institute of Medical Robotics, Shanghai Jiao Tong University(上海交通大学医学机器人研究所);State Key Laboratory of Precision and Intelligent Chemistry, University of Science and Technology of China(科学技术大学精密与智能化学国家重点实验室)
UNet with Self-Adaptive Mamba-Like Attention and Causal-Resonance Learning for Medical Image Segmentation
Faculty of Computing and IT (FCIT)(计算与信息技术学院);Sohar University(索哈尔大学);Department of Intelligent Systems(智能系统系);KTH Royal Institute of Technology(皇家理工学院);College of Computer and Information Sciences(计算机与信息科学学院);Imam Mohammad Ibn Saud Islamic University (IMSIU)(伊玛目穆罕默德·本·沙特伊斯兰大学);University of Auckland(奥克兰大学);Department of Computer Science, Faculty of Science(科学学院计算机科学系);Northern Border University(北方边境大学)
MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation
Imperial College London(伦敦帝国学院);Royal Brompton Hospital(皇家布朗普顿医院);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);University of Cambridge(剑桥大学)
Mamba Based Feature Extraction And Adaptive Multilevel Feature Fusion For 3D Tumor Segmentation From Multi-modal Medical Image
School of Computer Science and Engineering, Central South University, Changsha, 410083, China(计算机科学与工程学院,中南大学,长沙,410083,中国);Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University, Changsha, 410083, China(机器视觉与智能医学工程研究中心,中南大学,长沙,410083,中国);Department of Radiation Oncology, Washington University in St. Louis, USA(放射肿瘤科,华盛顿大学圣路易斯分校,美国);Department of Nuclear Medicine, Henri Becquerel Cancer Center, Rouen, France(核医学科,亨利·贝克勒尔癌症中心,鲁昂,法国);University of Rouen-Normandy, AMIS - QuantIF UR 4108, F-76000, Rouen, France(鲁昂-诺曼底大学,AMIS - QuantIF UR 4108,法国,F-76000,鲁昂,法国)
HybridMamba: A Dual-domain Mamba for 3D Medical Image Segmentation
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Department of Radiology, Fudan University Shanghai Cancer Center(复旦大学上海肿瘤中心放射科);Department of Oncology, Shanghai Medical College, Fudan University(复旦大学上海医学院肿瘤科);The Hong Kong University of Science and Technology(香港科学与技术大学)
A Comprehensive Survey of Mamba Architectures for Medical Image Analysis: Classification, Segmentation, Restoration and Beyond
Indian Institute of Technology Indore, India;R.M.D. Engineering College, Kavaraipettai, India;Jio Platforms Limited, India;Birla Institute of Technology \& Science Pilani, India
XFMamba: Cross-Fusion Mamba for Multi-View Medical Image Classification
Digital Environment Research Institute (DERI), Queen Mary University of London(伦敦大学玛丽女王学院数字环境研究所(DERI));School of Electronic Engineering and Computer Science, Queen Mary University of London(伦敦大学玛丽女王学院电子工程与计算机科学学院);Blizard Institute - Faculty of Medicine and Dentistry, Queen Mary University of London(伦敦大学玛丽女王学院医学与牙科学院布利扎德研究所);University of Cambridge(剑桥大学)
Fudan University(复旦大学);Ruijin Hospital, Shanghai Jiaotong University(上海交通大学医学院附属瑞金医院);Tongji Hospital, Huazhong University of Science and Technology(华中科技大学同济医学院附属同济医院);Leiden University Medical Center(莱顿大学医学中心)
Convolutional neural network (CNN), in particular the Unet, is a powerful method for medical image segmentation. To date Unet has demonstrated state-of-art performance in many complex medical image segmentation tasks, especially under the condition when the training and testing data share the same distribution (i.e. come from the same source domain). However, in clinical practice, medical images are acquired from different vendors and centers. The performance of a U-Net trained from a particular source domain, when transferred to a different target domain (e.g. different vendor, acquisition pa…
The George Washington University Medical Center(乔治华盛顿大学医学中心)
Recently, deep learning has become much more popular in computer vision area. The Convolution Neural Network (CNN) has brought a breakthrough in images segmentation areas, especially, for medical images. In this regard, U-Net is the predominant approach to medical image segmentation task. The U-Net not only performs well in segmenting multimodal medical images generally, but also in some tough cases of them. However, we found that the classical U-Net architecture has limitation in several aspects. Therefore, we applied modifications: 1) designed efficient CNN architecture to replace encoder an…
Enhancing Global Sensitivity and Uncertainty Quantification in Medical Image Reconstruction with Monte Carlo Arbitrary-Masked Mamba
Imperial College London(帝国理工学院);Royal Brompton Hospital(皇家布朗普顿医院);College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区生物医学工程学院);Human Phenome Institute, Fudan University(复旦大学人类表型组研究院);Inselspital, University of Bern(伯尔尼大学因塞尔医院);Technical University of Munich(慕尼黑工业大学)
UNetMamba: An Efficient UNet-Like Mamba for Semantic Segmentation of High-Resolution Remote Sensing Images
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);Key Laboratory of Target Cognition and Application Technology, CAS(中国科学院目标认知与应用技术重点实验室);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院)
Automatic extraction of liver and tumor from CT volumes is a challenging task due to their heterogeneous and diffusive shapes. Recently, 2D and 3D deep convolutional neural networks have become popular in medical image segmentation tasks because of the utilization of large labeled datasets to learn hierarchical features. However, 3D networks have some drawbacks due to their high cost on computational resources. In this paper, we propose a 3D hybrid residual attention-aware segmentation method, named RA-UNet, to precisely extract the liver volume of interests (VOI) and segment tumors from the l…
In this paper, we present UNet++, a new, more powerful architecture for medical image segmentation. Our architecture is essentially a deeply-supervised encoder-decoder network where the encoder and decoder sub-networks are connected through a series of nested, dense skip pathways. The re-designed skip pathways aim at reducing the semantic gap between the feature maps of the encoder and decoder sub-networks. We argue that the optimizer would deal with an easier learning task when the feature maps from the decoder and encoder networks are semantically similar. We have evaluated UNet++ in compari…
I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling
Department of Electrical and Electronics Engineering, and National Magnetic Resonance Research Center, Bilkent University(电子工程系和国家磁共振研究中心,比尔肯特大学);Department of Electrical Engineering, Stanford University(电气工程系,斯坦福大学)
MedMamba: Vision Mamba for Medical Image Classification
School of Biomedical Engineering(生物医学工程学院);Guangzhou Medical University(广州医科大学);School of Mathematics and Systems Science(数学与系统科学学院);Guangdong Polytechnic Normal University(广东技术师范大学)
CM-UNet: Hybrid CNN-Mamba UNet for Remote Sensing Image Semantic Segmentation
College of Information Science and Electronic Engineering, Zhejiang University(浙江大学信息与电子工程学院);School of Aeronautics and Astronautics, Zhejiang University(浙江大学航空航天学院);College of Computer Science, Zhejiang University(浙江大学计算机学院)
SAMba-UNet: SAM2-Mamba UNet for Cardiac MRI in Medical Robotic Perception
University of Electronic Science and Technology of China(电子科技大学);University of Chinese Academy of Sciences(中国科学院大学);School of Computer Science, Peking University(北京大学计算机学院)
Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究所)
The encoder-decoder model is a commonly used Deep Neural Network (DNN) model for medical image segmentation. Conventional encoder-decoder models make pixel-wise predictions focusing heavily on local patterns around the pixel. This makes it challenging to give segmentation that preserves the object's shape and topology, which often requires an understanding of the global context of the object. In this work, we propose a Fourier Coefficient Segmentation Network~(FCSN) -- a novel DNN-based model that segments an object by learning the complex Fourier coefficients of the object's masks. The Fourie…
FaRMamba: Frequency-based learning and Reconstruction aided Mamba for Medical Segmentation
School of Artificial Intelligence and Computer Science, Nantong University, China(人工智能与计算机科学学院,南通大学);School of Information Science and Technology, Nantong University, China(信息科学与技术学院,南通大学)
Attention-Mamba: A Mamba-Enhanced Multi-Scale Parallel Inference Network for Medical Image Segmentation
School of Astronautics, Northwestern Polytechnical University(航天学院,西北工业大学);Department of Electronics and Telecommunications, Politecnico di Torino(电信系,托斯卡纳理工学院);Beijing Aerospace Automatic Control Research Institute(北京航天自动控制研究所);Xi'an University of Posts and Telecommunications(西安邮电大学);Department of Oncology, University of Turin(肿瘤科,都灵大学);Candiolo Cancer Institute, FPO-IRCCS(坎迪奥利癌症研究所,FPO-IRCCS)
Topology-Aware Wavelet Mamba for Airway Structure Segmentation in Postoperative Recurrent Nasopharyngeal Carcinoma CT Scans
School of Software Engineering, Sun Yat-sen University(中山大学软件工程学院);School of Microelectronics, Shanghai University(上海大学微电子学院);Electronic and Computer Engineering, The Hong Kong University of Science and Technology(香港科技大学电子与计算机工程系);Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属瑞金医院);Eye & ENT Hospital, Fudan University(复旦大学附属眼耳鼻喉科医院)
LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation
School of Computer Science, Peking University(北京大学计算机学院);Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能研究院);Key Laboratory of High Confidence Software Technologies, Ministry of Education(教育部高可信软件技术重点实验室);National Engineering Research Center for Software Engineering, Peking University(北京大学国家软件工程研究中心)
Huazhong University of Science and Technology(华中科技大学);Shenzhen University(深圳大学)
Deep convolutional neural network (CNN) achieves remarkable performance for medical image analysis. UNet is the primary source in the performance of 3D CNN architectures for medical imaging tasks, including brain tumor segmentation. The skip connection in the UNet architecture concatenates features from both encoder and decoder paths to extract multi-contextual information from image data. The multi-scaled features play an essential role in brain tumor segmentation. However, the limited use of features can degrade the performance of the UNet approach for segmentation. In this paper, we propose…
UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentation
Data Science Institute, Vanderbilt University(维斯尼尔大学数据科学学院);College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院)
LKM-UNet: Large Kernel Vision Mamba UNet for Medical Image Segmentation
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Institute of Wenzhou, Zhejiang University(浙江大学温州研究院);The Second Affiliated Hospital, Zhejiang University School of Medicine(浙江大学医学院附属第二医院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Notre Dame(圣母大学)
ACM-UNet: Adaptive Integration of CNNs and Mamba for Efficient Medical Image Segmentation
Wuhan University of Technology(武汉理工大学);Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院北京协和医学院);Zhongnan Hospital of Wuhan University(武汉大学中南医院)
Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised learning framework with tailored proxy tasks for medical image analysis. Specifically, we propose: (i) a new 3D transformer-based model, dubbed Swin UNEt TRansformers (Swin UNETR), with a hierarchical encoder for self-supervised pre-training; (ii) tailored proxy tasks for learning the underlying pattern of human anatomy. We demonstrate successful pre-training of…
Vision Transformers (ViT)s have recently become popular due to their outstanding modeling capabilities, in particular for capturing long-range information, and scalability to dataset and model sizes which has led to state-of-the-art performance in various computer vision and medical image analysis tasks. In this work, we introduce a unified framework consisting of two architectures, dubbed UNetFormer, with a 3D Swin Transformer-based encoder and Convolutional Neural Network (CNN) and transformer-based decoders. In the proposed model, the encoder is linked to the decoder via skip connections at…
VM-UNET-V2 Rethinking Vision Mamba UNet for Medical Image Segmentation
State Key Laboratory for Novel Software Technology, Nanjing University(南京大学计算机软件新技术国家重点实验室);Huazhong University of Science and Technology(华中科技大学);Jiangsu Province Hospital of Chinese Medicine(江苏省中医院)
VM-UNet: Vision Mamba UNet for Medical Image Segmentation
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院)