State Space Models (SSM), such as Mamba, have shown strong representation ability in modeling long-range dependency with linear complexity, achieving successful applications from high-level to low-level vision tasks. However, SSM's sequential nature necessitates multiple scans in different directions to compensate for the loss of spatial dependency when unfolding the image into a 1D sequence. This multi-direction scanning strategy significantly increases the computation overhead and is unbearable for high-resolution image processing. To address this problem, we propose a novel Hierarchical Mamba network, namely, Hi-Mamba, for image super-resolution (SR). Hi-Mamba consists of two key designs: (1) The Hierarchical Mamba Block (HMB) assembled by a Local SSM (L-SSM) and a Region SSM (R-SSM) both with the single-direction scanning, aggregates multi-scale representations to enhance the context modeling ability. (2) The Direction Alternation Hierarchical Mamba Group (DA-HMG) allocates the isomeric single-direction scanning into cascading HMBs to enrich the spatial relationship modeling. Extensive experiments demonstrate the superiority of Hi-Mamba across five benchmark datasets for efficient SR. For example, Hi-Mamba achieves a significant PSNR improvement of 0.29 dB on Manga109 for $\times3$ SR, compared to the strong lightweight MambaIR.
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University(中南大学机器视觉与智能医学湖南省工程研究中心);Department of Nuclear Medicine, Henri Becquerel Cancer Center(亨利·贝克勒尔癌症中心核医学科);University of Rouen-Normandy(鲁昂-诺曼底大学)
Transformer-Progressive Mamba Network for Lightweight Image Super-Resolution
Bell Honors School, Nanjing University of Posts and Telecommunications(南京邮电大学贝尔荣誉学院);State Key Laboratory of Integrated Services Networks, Xidian University(西安电子科技大学集成服务网络国家重点实验室);Pattern Recognition and Intelligent System Laboratory, School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院模式识别与智能系统实验室);Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院智能感知与高维信息系统教育部重点实验室);Department of Electrical Engineering and the Institute of Communications Engineering, National Tsing Hua University(国立交通大学电子工程系与通信工程研究所)
MambaVSR: Content-Aware Scanning State Space Model for Video Super-Resolution
Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学学院);Visual Intelligence + X International Cooperation Joint Laboratory of MOE, Beijing Jiaotong University(教育部视觉智能+X国际合作联合实验室);School of Computer and Communication Engineering, University of Science and Technology Beijing(北京科技大学计算机与通信工程学院)
MambaX: Image Super-Resolution with State Predictive Control
Southeast University(东南大学);Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院航空信息研究所);College of Resources and Environment, University of Chinese Academy of Sciences(中国科学院大学资源与环境学院);School of Mathematics, Southeast University(东南大学数学学院);Department of Complexity Science and Engineering, Graduate School of Frontier Sciences, the University of Tokyo(东京大学前沿科学研究院复杂科学与工程部门);Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK(格勒诺布尔阿尔卑斯大学、Inria、CNRS、Grenoble INP、LJK)
Frequency-Assisted Mamba for Remote Sensing Image Super-Resolution
School of Geodesy and Geomatics, Wuhan University(武汉大学测绘学院);School of Computer Science and Technology, Harbin Institute of Technology(哈尔滨工业大学计算机科学与技术学院);Information Science and Technology College, Dalian Maritime University(大连海事大学信息科学技术学院);National Tsing Hua University(国立清华大学)
Exploring Non-Local Spatial-Angular Correlations with a Hybrid Mamba-Transformer Framework for Light Field Super-Resolution
School of Information Science and Engineering, Huaqiao University(华侨大学信息科学与工程学院);School of Mechanical Engineering and Automation, Huaqiao University(华侨大学机械工程与自动化学院);School of Engineering, Huaqiao University(华侨大学工程学院);School of Optoelectronic and Communication Engineering, Xiamen University of Technology(厦门理工大学光电子与通信工程学院);Artificial Intelligence Institute, Hangzhou Dianzi University(杭州电子科技大学人工智能学院)
Wavelet-Assisted Mamba for Satellite-Derived Sea Surface Temperature Super-Resolution
State Key Laboratory of Physical Oceanography(物理海洋学国家重点实验室);Frontiers Science Center for Deep Ocean Multispheres and Earth System(深海多球体与地球系统前沿科学中心);Ocean University of China(中国海洋大学);Faculty of Information Science and Engineering(信息科学与工程学院);Department of Electrical and Computer Engineering(电气与计算机工程系)
GraspMamba: A Mamba-based Language-driven Grasp Detection Framework with Hierarchical Feature Learning
Automation & Control Institute, TU Wien(维也纳技术大学自动化与控制研究所);Austrian Institute of Technology (AIT) GmbH(奥地利技术研究院);MBZUAI(穆罕默德·本·扎耶德人工智能大学);University of Liverpool(利物浦大学)
DH-Mamba: Exploring Dual-domain Hierarchical State Space Models for MRI Reconstruction
School of Basic Medical Science, Fudan University(复旦大学基础医学院);Academy of Engineering and Technology, Fudan University(复旦大学工程与技术学院);Shandong Computer Science Center (National Supercomputer Center in Jinan)(山东计算机科学中心(国家济南超级计算中心))
EMMA: Empowering Multi-modal Mamba with Structural and Hierarchical Alignment
Peng Cheng Laboratory(鹏城实验室);University of Chinese Academy of Sciences(中国科学院大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Sun Yat-sen University(中山大学)
H-MBA: Hierarchical MamBa Adaptation for Multi-Modal Video Understanding in Autonomous Driving
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);School of Artificial Intelligence, University of Chinese Academy of Science(中国科学院大学人工智能学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Hong Kong University of Science and Technology(香港科技大学);The Hong Kong Polytechnic University(香港理工大学)
Mamba Goes HoME: Hierarchical Soft Mixture-of-Experts for 3D Medical Image Segmentation
Faculty of Mathematics, Informatics, and Mechanics, University of Warsaw(华沙大学数学、信息学与力学系);Faculty of Mathematics and Computer Science, Jagiellonian University(雅盖隆大学数学与计算机科学系);Institute of AI for Health, Helmholtz Munich(海德堡医学院人工智能与健康研究所);Faculty of Electronics and Information Technology, Warsaw University of Technology(华沙理工大学电子与信息技术系);NASK - National Research Institute(国家研究 institute);Faculty of Radiology, Massachusetts General Hospital(麻省总医院放射学系);Department of Radiology, Harvard Medical School(哈佛医学院放射学系)
Coarse-to-fine Hierarchical Architecture with Sequential Mamba for Brain Reconstruction
Chonnam National University, Gwangju, Republic of Korea(全罗国立大学,韩国光州市);Vietnam National University - Ho Chi Minh City, University of Science, Vietnam(越南国家大学-胡志明市,越南科学大学);Institute for Cybersecurity and Digital Technologies, Russia(俄罗斯网络安全与数字技术研究所)
MATHENA: Mamba-based Architectural Tooth Hierarchical Estimator and Holistic Evaluation Network for Anatomy
OUTTA;Seoul National University(首尔国立大学);Sangmyung University(祥明大学);Gwangju Institute of Science and Technology(光州科学技术院);Samsung Medical Center, Sungkyunkwan University(三星医学中心,成均馆大学);Samsung Changwon Hospital, Sungkyunkwan University(三星昌原医院,成均馆大学);NVIDIA AI Technology Center(英伟达人工智能技术中心)
UINO-FSS: Unifying Representation Learning and Few-shot Segmentation via Hierarchical Distillation and Mamba-HyperCorrelation
School of Artificial Intelligence and the National Engineering Laboratory of Big Data System Computing Technology, Shenzhen University(人工智能学院和大数据系统计算技术国家工程实验室,深圳大学);Guangdong Provincial Key Laboratory of Intelligent Information Processing, China(广东省智能信息处理重点实验室,中国);School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University(生物医学工程学院,深圳大学医学院,深圳大学);Department of Computer Science, University of Nottingham Ningbo China(计算机科学系,宁波大学中国)
CECT-Mamba: a Hierarchical Contrast-enhanced-aware Model for Pancreatic Tumor Subtyping from Multi-phase CECT
Southeast University(东南大学);Medical School of Southeast University(东南大学医学院);Zhongda Hospital(中大医院);Zhejiang University(浙江大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
IGroupSS-Mamba: Interval Group Spatial-Spectral Mamba for Hyperspectral Image Classification
Nanjing University of Information Science and Technology(南京信息工程大学);Institute of Optics and Electronics(光学电子研究所);China University of Geosciences(中国地质大学);University of Extremadura(埃斯特雷马杜拉大学)
Global and Local Mamba Network for Multi-Modality Medical Image Super-Resolution
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University(中南大学机器视觉与智能医学湖南省工程研究中心);University of Rouen-Normandy(鲁昂-诺曼底大学);Henri Becquerel Cancer Center(亨利·贝克勒尔癌症中心)
DeflareMamba: Hierarchical Vision Mamba for Contextually Consistent Lens Flare Removal
School of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院);Engineering Research Center of Intelligent Technology and Educational Application, Ministry of Education(教育部智能技术与教育应用工程研究中心)
Graph Mamba Survival Analysis Based on Topology-Aware ordering
School of Mathematics and Statistics(数学与统计学学院);West China Science and Technology Innovation Harbor(西部科学与技术创新港);School of Computer Science and Technology(计算机科学与技术学院)
ECP-Mamba: An Efficient Multi-scale Self-supervised Contrastive Learning Method with State Space Model for PolSAR Image Classification
School of Information and Communications Engineering, Xi’an Jiaotong University(西安交通大学信息与通信工程学院);Department of Mathematics and Fundamental Research, Peng Cheng Laboratory(鹏城实验室数学与基础研究部);School of Mathematics and Statistics, Xi’an Jiaotong University(西安交通大学数学与统计学院)
Diversity-enhanced Collaborative Mamba for Semi-supervised Medical Image Segmentation
School of Intelligence Science and Technology, Nanjing University(智能科学与技术学院、南京大学);School of Electrical and Information Engineering, The University of Sydney(电气与信息工程学院、悉尼大学)
DepMamba: Progressive Fusion Mamba for Multimodal Depression Detection
Institute of Science and Technology for Brain-inspired Intelligence, Fudan University(复旦大学脑智能科学与技术研究院);School of Computer Science, Fudan University(复旦大学计算机科学技术学院)
Hybrid Transformer-Mamba for Weakly Supervised Volumetric Medical Segmentation
University of Western Australia(西澳大学);Harry Perkins Institute of Medical Research(哈利·佩金斯医学研究所);National Imaging Facility(国家成像设施);Fiona Stanley Hospital(菲奥娜·斯蒂尔医院);Victor Chang Cardiac Research Institute(维多利亚·张心脏研究中心)
Self-Prior Guided Mamba-UNet Networks for Medical Image Super-Resolution
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University(中南大学机器视觉与智能医学湖南省工程研究中心);Department of Nuclear Medicine, Henri Becquerel Cancer Center(亨利·贝克勒尔癌症中心核医学科);University of Rouen-Normandy(鲁昂-诺曼底大学)