UD-Mamba: A pixel-level uncertainty-driven Mamba model for medical image segmentation
University of California, Santa Cruz(加州大学圣克鲁兹分校);Johns Hopkins University(约翰霍普金斯大学);Stanford University(斯坦福大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Adelaide(阿德莱德大学)
Recent advancements have highlighted the Mamba framework, a state-space model known for its efficiency in capturing long-range dependencies with linear computational complexity. While Mamba has shown competitive performance in medical image segmentation, it encounters difficulties in modeling local features due to the sporadic nature of traditional location-based scanning methods and the complex, ambiguous boundaries often present in medical images. To overcome these challenges, we propose Uncertainty-Driven Mamba (UD-Mamba), which redefines the pixel-order scanning process by incorporating channel uncertainty into the scanning mechanism. UD-Mamba introduces two key scanning techniques: 1) sequential scanning, which prioritizes regions with high uncertainty by scanning in a row-by-row fashion, and 2) skip scanning, which processes columns vertically, moving from high-to-low or low-to-high uncertainty at fixed intervals. Sequential scanning efficiently clusters high-uncertainty regions, such as boundaries and foreground objects, to improve segmentation precision, while skip scanning enhances the interaction between background and foreground regions, allowing for timely integration of background information to support more accurate foreground inference. Recognizing the advantages of scanning from certain to uncertain areas, we introduce four learnable parameters to balance the importance of features extracted from different scanning methods. Additionally, a cosine consistency loss is employed to mitigate the drawbacks of transitioning between uncertain and certain regions during the scanning process. Our method demonstrates robust segmentation performance, validated across three distinct medical imaging datasets involving pathology, dermatological lesions, and cardiac tasks.
LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation
School of Computer Science, Peking University(北京大学计算机学院);Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能研究院);Key Laboratory of High Confidence Software Technologies, Ministry of Education(教育部高可信软件技术重点实验室);National Engineering Research Center for Software Engineering, Peking University(北京大学国家软件工程研究中心)
VM-UNET-V2 Rethinking Vision Mamba UNet for Medical Image Segmentation
State Key Laboratory for Novel Software Technology, Nanjing University(南京大学计算机软件新技术国家重点实验室);Huazhong University of Science and Technology(华中科技大学);Jiangsu Province Hospital of Chinese Medicine(江苏省中医院)
Mamba Goes HoME: Hierarchical Soft Mixture-of-Experts for 3D Medical Image Segmentation
Faculty of Mathematics, Informatics, and Mechanics, University of Warsaw(华沙大学数学、信息学与力学系);Faculty of Mathematics and Computer Science, Jagiellonian University(雅盖隆大学数学与计算机科学系);Institute of AI for Health, Helmholtz Munich(海德堡医学院人工智能与健康研究所);Faculty of Electronics and Information Technology, Warsaw University of Technology(华沙理工大学电子与信息技术系);NASK - National Research Institute(国家研究 institute);Faculty of Radiology, Massachusetts General Hospital(麻省总医院放射学系);Department of Radiology, Harvard Medical School(哈佛医学院放射学系)
VM-UNet: Vision Mamba UNet for Medical Image Segmentation
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院)
Mamba-Sea: A Mamba-based Framework with Global-to-Local Sequence Augmentation for Generalizable Medical Image Segmentation
Shanghai Jiao Tong University School of Medicine(上海交通大学医学院);National Institute of Healthcare Data Science(健康数据科学国家研究院);State Key Laboratory for Novel Software Technology(新型软件技术国家重点实验室);School of Computer Science and Engineering(计算机科学与工程学院);Key Lab of Computer Network and Information Integration(计算机网络与信息集成重点实验室);School of Electrical and Information Engineering(电气与信息工程学院);The University of Sydney(悉尼大学)
Diversity-enhanced Collaborative Mamba for Semi-supervised Medical Image Segmentation
School of Intelligence Science and Technology, Nanjing University(智能科学与技术学院、南京大学);School of Electrical and Information Engineering, The University of Sydney(电气与信息工程学院、悉尼大学)
TK-Mamba: Marrying KAN With Mamba for Text-Driven 3D Medical Image Segmentation
Zhejiang University(浙江大学);Research Center, National Certification Technology (Hangzhou) Co., Ltd(国家认证技术(杭州)有限公司研究部);Shanghai Jiao Tong University(上海交通大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);East China Normal University(华东师范大学)
LKM-UNet: Large Kernel Vision Mamba UNet for Medical Image Segmentation
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Institute of Wenzhou, Zhejiang University(浙江大学温州研究院);The Second Affiliated Hospital, Zhejiang University School of Medicine(浙江大学医学院附属第二医院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Notre Dame(圣母大学)
SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentation
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Beijing Academy of Artificial Intelligence(北京智源人工智能研究院);The Hong Kong University of Science and Technology(香港科技大学)
Mamba, a State Space Model (SSM), has recently shown competitive performance to Convolutional Neural Networks (CNNs) and Transformers in Natural Language Processing and general sequence modeling. Various attempts have been made to adapt Mamba to Computer Vision tasks, including medical image segmentation (MIS). Vision Mamba (VM)-based networks are particularly attractive due to their ability to achieve global receptive fields, similar to Vision Transformers, while also maintaining linear complexity in the number of tokens. However, the existing VM models still struggle to maintain both spatial…
BiSegMamba: Efficient Bidirectional Tri-Oriented Mamba for 3D Medical Image Segmentation
School of Computer Science and Engineering, Beihang University(北航计算机科学与工程学院);State Key Laboratory of Virtual Reality Technology and Systems, Beihang University(北航虚拟现实技术与系统国家重点实验室)
MS-UMamba: An Improved Vision Mamba Unet for Fetal Abdominal Medical Image Segmentation
Guangxi Key Laboratory of Machine Vision and Intelligent Control(广西机器视觉与智能控制重点实验室);Wuzhou University(梧州大学);College of Electronical and Information Engineering(电子信息工程学院);Wuzhou Medical College(梧州医学院);School of Microelectronics(微电子学院);Southern Medical University(南方医科大学)
Swin-UMamba: Mamba-based UNet with ImageNet-based pretraining
Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院保罗·C·劳特伯生物医学成像研究中心);Peng Cheng Laboratory(鹏城实验室);University of Chinese Academy of Sciences(中国科学院大学);The University of Hong Kong(香港大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
School of Advanced Technology, Xi’an Jiaotong-Liverpool University(西交利物浦大学先进技术学院);School of Electronics and Information Engineering, Beihang University(北京航空航天大学电子信息工程学院);Cambridge University(剑桥大学);Beijing Shijitan Hospital, Capital Medical University(首都医科大学附属北京世纪坛医院);University of Liverpool(利物浦大学)
HyM-UNet: Synergizing Local Texture and Global Context via Hybrid CNN-Mamba Architecture for Medical Image Segmentation
School of Information and Communication Engineering, Beijing University of Posts and Communications (BUPT)(信息与通信工程学院,北京邮电大学);Alibaba Cloud AI Labs(阿里云人工智能实验室)
ACM-UNet: Adaptive Integration of CNNs and Mamba for Efficient Medical Image Segmentation
Wuhan University of Technology(武汉理工大学);Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院北京协和医学院);Zhongnan Hospital of Wuhan University(武汉大学中南医院)
SpineMamba: Enhancing 3D Spinal Segmentation in Clinical Imaging through Residual Visual Mamba Layers and Shape Priors
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Northeast Petroleum University(东北石油大学);Northeastern University(东北大学);Southern Medical University(南方医科大学)
Unified Medical Image Segmentation with State Space Modeling Snake
Sun Yat-sen University(中山大学);Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);Beijing University of Posts and Telecommunications(北京邮电大学);The Australian National University(澳大利亚国立大学)
MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation
Imperial College London(伦敦帝国学院);Royal Brompton Hospital(皇家布朗普顿医院);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);University of Cambridge(剑桥大学)
RUFNet: Query-Guided Support Mask Refinement and Uncertainty Fusion based on Hybrid Mamba for Few-Shot Brain Tumor Segmentation
Department of Language Science and Technology, The Hong Kong Polytechnic University(香港理工大学语言科学与技术系);School of Artificial Intelligence, Chongqing University of Technology(重庆理工大学人工智能学院);Affiliated Lianyungang Hospital of Xuzhou Medical University(徐州医科大学附属连云港医院);College of Mechatronics and Control Engineering, Shenzhen University(深圳大学机电与控制工程学院)
{S$^3$-Mamba}: Small-Size-Sensitive Mamba for Lesion Segmentation
Shenzhen University(深圳大学);University of Nottingham Ningbo China(宁波诺丁汉大学);Guangxi Medical University(广西医科大学);City University of Hong Kong(香港城市大学);University of Nottingham(诺丁汉大学)
Deep neural networks have achieved satisfactory performance in piles of medical image analysis tasks. However the training of deep neural network requires a large amount of samples with high-quality annotations. In medical image segmentation, it is very laborious and expensive to acquire precise pixel-level annotations. Aiming at training deep segmentation models on datasets with probably corrupted annotations, we propose a novel Meta Corrupted Pixels Mining (MCPM) method based on a simple meta mask network. Our method is targeted at automatically estimate a weighting map to evaluate the impor…
MambaTrans: Multimodal Fusion Image Translation via Large Language Model Priors for Downstream Visual Tasks
School of Physics and Optoelectronic Engineering(物理与光电工程学院);Guangdong-HongKong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology(粤港澳联合智能微纳光电技术实验室);School of Information Engineering and Automation(信息工程与自动化学院)
本文提出MambaTrans,一种多模态融合图像模态翻译器,利用多模态大语言模型描述和语义分割掩码作为输入,通过Multi-Model State Space Block捕获跨模态依赖,在不调整预训练模型参数的情况下提升下游视觉任务性能。
GIGP: A Global Information Interacting and Geometric Priors Focusing Framework for Semi-supervised Medical Image Segmentation
The School of Mathematical Science, Capital Normal University(首都师范大学数学科学学院);The Academy for Multidisciplinary Studies, Capital Normal University(首都师范大学交叉科学研究院)
CAMS: Convolution and Attention-Free Mamba-based Cardiac Image Segmentation
School of Electronic Engineering and Computer Science, Queen Mary University of London(伦敦玛丽女王大学电子工程与计算机科学学院);Queen Mary’s Digital Environment Research Institute (DERI)(伦敦玛丽女王大学数字环境研究所);Department of Computer Science, University College London(伦敦大学学院计算机科学系);School of Engineering and Materials Science, Queen Mary University of London(伦敦玛丽女王大学工程与材料科学学院)