Recently, State Space Models (SSMs), with Mamba as a prime example, have shown great promise for long-range dependency modeling with linear complexity. Then, Vision Mamba and the subsequent architectures are presented successively, and they perform well on visual tasks. The crucial step of applying Mamba to visual tasks is to construct 2D visual features in sequential manners. To effectively organize and construct visual features within the 2D image space through 1D selective scan, we propose a novel Multi-Head Scan (MHS) module. The embeddings extracted from the preceding layer are projected into multiple lower-dimensional subspaces. Subsequently, within each subspace, the selective scan is performed along distinct scan routes. The resulting sub-embeddings, obtained from the multi-head scan process, are then integrated and ultimately projected back into the high-dimensional space. Moreover, we incorporate a Scan Route Attention (SRA) mechanism to enhance the module's capability to discern complex structures. To validate the efficacy of our module, we exclusively substitute the 2D-Selective-Scan (SS2D) block in VM-UNet with our proposed module, and we train our models from scratch without using any pre-trained weights. The results indicate a significant improvement in performance while reducing the parameters of the original VM-UNet. The code for this study is publicly available at https://github.com/PixDeep/MHS-VM.
UD-Mamba: A pixel-level uncertainty-driven Mamba model for medical image segmentation
University of California, Santa Cruz（加州大学圣克鲁兹分校）；Johns Hopkins University（约翰霍普金斯大学）；Stanford University（斯坦福大学）；Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）；University of Adelaide（阿德莱德大学）
State Key Laboratory of Physical Oceanography, Ocean University of China（中国海洋大学物理海洋学国家重点实验室）；School of Cyber Science and Technology, Sun Yat-Sen University（中山大学信息科学与技术学院）；Department of Electrical and Computer Engineering, Mississippi State University（密苏里州立大学电气与计算机工程系）
3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification
Nanjing University of Information Science and Technology（南京信息工程大学）；Institute of Optics and Electronics（光学电子研究所）；China University of Geosciences（中国地质大学）；University of Extremadura（埃斯特雷马杜拉大学）
DH-Mamba: Exploring Dual-domain Hierarchical State Space Models for MRI Reconstruction
School of Basic Medical Science, Fudan University（复旦大学基础医学院）；Academy of Engineering and Technology, Fudan University（复旦大学工程与技术学院）；Shandong Computer Science Center (National Supercomputer Center in Jinan)（山东计算机科学中心（国家济南超级计算中心））
MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion
The Hong Kong Polytechnic University（香港理工大学）；University of Science and Technology of China（中国科学技术大学）；Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；Stanford University（斯坦福大学）
Cross-Scan Mamba with Masked Training for Robust Spectral Imaging
University of Helsinki（赫尔辛基大学）；IMEC（微电子中心）；Universiteit Gent（根特大学）；Northwestern Polytechnical University（西北工业大学）；Harbin Institute of Technology (Shenzhen)（哈尔滨工业大学（深圳））
School of Advanced Technology, Xi’an Jiaotong-Liverpool University（西交利物浦大学先进技术学院）；School of Electronics and Information Engineering, Beihang University（北京航空航天大学电子信息工程学院）；Cambridge University（剑桥大学）；Beijing Shijitan Hospital, Capital Medical University（首都医科大学附属北京世纪坛医院）；University of Liverpool（利物浦大学）
SliceMamba with Neural Architecture Search for Medical Image Segmentation
School of Computer Science, Beijing University of Technology（北京工业大学计算机科学学院）；Xiaomi Inc（小米公司）；Department of Radiology, Capital Medical University Affiliated Beijing Friendship Hospital（首都医科大学附属北京友谊医院放射科）；New Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所模式识别新实验室）
MambaVC: Learned Visual Compression with Selective State Spaces
Tsinghua Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）；Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳））；Peng Cheng Laboratory（鹏城实验室）；Huawei Technologies Company Ltd.（华为技术有限公司）；Shenzhen University（深圳大学）
VRS-UIE: Value-Driven Reordering Scanning for Underwater Image Enhancement
School of Computer Science and Technology, Harbin Institute of Technology（哈尔滨工业大学计算机科学与技术学院）；Faculty of Information Technology, Beijing University of Technology（北京工业大学信息技术学院）
Vision-Proprioception Fusion with Mamba2 in End-to-End Reinforcement Learning for Motion Control
School of Computer Science and Statistics, Trinity College Dublin（都柏林三一学院计算机科学与统计学系）；Faculty of Engineering and Information Technology, University of Technology Sydney（新南威尔士大学理工学院）
