S-Lab, Nanyang Technological University(新加坡南洋理工大学S-Lab);Peking University(北京大学);Singapore University of Technology and Design(新加坡科技设计大学);University of Cologne(科隆大学);SenseTime Research(商汤科技研究院)
Many few-shot segmentation (FSS) methods use cross attention to fuse support foreground (FG) into query features, regardless of the quadratic complexity. A recent advance Mamba can also well capture intra-sequence dependencies, yet the complexity is only linear. Hence, we aim to devise a cross (attention-like) Mamba to capture inter-sequence dependencies for FSS. A simple idea is to scan on support features to selectively compress them into the hidden state, which is then used as the initial hidden state to sequentially scan query features. Nevertheless, it suffers from (1) support forgetting issue: query features will also gradually be compressed when scanning on them, so the support features in hidden state keep reducing, and many query pixels cannot fuse sufficient support features; (2) intra-class gap issue: query FG is essentially more similar to itself rather than to support FG, i.e., query may prefer not to fuse support features but their own ones from the hidden state, yet the success of FSS relies on the effective use of support information. To tackle them, we design a hybrid Mamba network (HMNet), including (1) a support recapped Mamba to periodically recap the support features when scanning query, so the hidden state can always contain rich support information; (2) a query intercepted Mamba to forbid the mutual interactions among query pixels, and encourage them to fuse more support features from the hidden state. Consequently, the support information is better utilized, leading to better performance. Extensive experiments have been conducted on two public benchmarks, showing the superiority of HMNet. The code is available at https://github.com/Sam1224/HMNet.
MambaPanoptic: A Vision Mamba-based Structured State Space Framework for Panoptic Segmentation
Technical University of Munich(慕尼黑技术大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Polytechnic University of Milan(米兰理工大学);University of Stuttgart(斯图加特大学);Wuhan University(武汉大学);Karlsruhe University of Applied Sciences(卡尔斯鲁厄应用科学大学)
TK-Mamba: Marrying KAN With Mamba for Text-Driven 3D Medical Image Segmentation
Zhejiang University(浙江大学);Research Center, National Certification Technology (Hangzhou) Co., Ltd(国家认证技术(杭州)有限公司研究部);Shanghai Jiao Tong University(上海交通大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);East China Normal University(华东师范大学)
CAMS: Convolution and Attention-Free Mamba-based Cardiac Image Segmentation
School of Electronic Engineering and Computer Science, Queen Mary University of London(伦敦玛丽女王大学电子工程与计算机科学学院);Queen Mary’s Digital Environment Research Institute (DERI)(伦敦玛丽女王大学数字环境研究所);Department of Computer Science, University College London(伦敦大学学院计算机科学系);School of Engineering and Materials Science, Queen Mary University of London(伦敦玛丽女王大学工程与材料科学学院)
Mamba-Sea: A Mamba-based Framework with Global-to-Local Sequence Augmentation for Generalizable Medical Image Segmentation
Shanghai Jiao Tong University School of Medicine(上海交通大学医学院);National Institute of Healthcare Data Science(健康数据科学国家研究院);State Key Laboratory for Novel Software Technology(新型软件技术国家重点实验室);School of Computer Science and Engineering(计算机科学与工程学院);Key Lab of Computer Network and Information Integration(计算机网络与信息集成重点实验室);School of Electrical and Information Engineering(电气与信息工程学院);The University of Sydney(悉尼大学)
CS-MUNet: A Channel-Spatial Dual-Stream Mamba Network for Multi-Organ Segmentation
School of Software Engineering(软件工程学院);The Chinese University of Hong Kong(香港中文大学);Yunnan Provincial Key Laboratory of Software Engineering(云南省软件工程重点实验室)
Diversity-enhanced Collaborative Mamba for Semi-supervised Medical Image Segmentation
School of Intelligence Science and Technology, Nanjing University(智能科学与技术学院、南京大学);School of Electrical and Information Engineering, The University of Sydney(电气与信息工程学院、悉尼大学)
School of Electronic and Computer Engineering, Peking University(北京大学电子与计算机工程学院);Aberdeen Institute of Data Science and Artificial Intelligence, South China Normal University(华南师范大学阿伯丁数据科学与人工智能学院)
UNetMamba: An Efficient UNet-Like Mamba for Semantic Segmentation of High-Resolution Remote Sensing Images
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);Key Laboratory of Target Cognition and Application Technology, CAS(中国科学院目标认知与应用技术重点实验室);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院)
MambaMIM: Pre-training Mamba with State Space Token Interpolation and its Application to Medical Image Segmentation
School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China(科学技术大学生物医学工程学院);Suzhou Institute for Advanced Research, University of Science and Technology of China(科学技术大学苏州市先进研究所);Center for Medical Imaging, Robotics, and Analytic Computing & LEarning (MIRACLE), Suzhou Institute for Advanced Research, USTC(医学影像、机器人与分析计算与学习中心);Department of Automation, Shanghai Jiao Tong University(上海交通大学自动化系);Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University(上海交通大学图像处理与模式识别研究所);Institute of Medical Robotics, Shanghai Jiao Tong University(上海交通大学医学机器人研究所);State Key Laboratory of Precision and Intelligent Chemistry, University of Science and Technology of China(科学技术大学精密与智能化学国家重点实验室)
{S$^3$-Mamba}: Small-Size-Sensitive Mamba for Lesion Segmentation
Shenzhen University(深圳大学);University of Nottingham Ningbo China(宁波诺丁汉大学);Guangxi Medical University(广西医科大学);City University of Hong Kong(香港城市大学);University of Nottingham(诺丁汉大学)
Mamba Based Feature Extraction And Adaptive Multilevel Feature Fusion For 3D Tumor Segmentation From Multi-modal Medical Image
School of Computer Science and Engineering, Central South University, Changsha, 410083, China(计算机科学与工程学院,中南大学,长沙,410083,中国);Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University, Changsha, 410083, China(机器视觉与智能医学工程研究中心,中南大学,长沙,410083,中国);Department of Radiation Oncology, Washington University in St. Louis, USA(放射肿瘤科,华盛顿大学圣路易斯分校,美国);Department of Nuclear Medicine, Henri Becquerel Cancer Center, Rouen, France(核医学科,亨利·贝克勒尔癌症中心,鲁昂,法国);University of Rouen-Normandy, AMIS - QuantIF UR 4108, F-76000, Rouen, France(鲁昂-诺曼底大学,AMIS - QuantIF UR 4108,法国,F-76000,鲁昂,法国)
Hybrid Transformer-Mamba for Weakly Supervised Volumetric Medical Segmentation
University of Western Australia(西澳大学);Harry Perkins Institute of Medical Research(哈利·佩金斯医学研究所);National Imaging Facility(国家成像设施);Fiona Stanley Hospital(菲奥娜·斯蒂尔医院);Victor Chang Cardiac Research Institute(维多利亚·张心脏研究中心)
Vivim: a Video Vision Mamba for Medical Video Segmentation
The Hong Kong University of Science and Technology, Guangzhou(香港科技大学(广州));The University of Hong Kong(香港大学);Guangdong Provincial People’s Hospital(广东省人民医院);Institute of High Performance Computing, A*STAR(新加坡高性能计算研究院(新加坡科研局下属机构));Hong Kong University of Science and Technology(香港科技大学)
AVS-Mamba: Exploring Temporal and Multi-modal Mamba for Audio-Visual Segmentation
School of Information and Communication Engineering, Dalian University of Technology(大连理工大学信息与通信工程学院);School of Innovation and Entrepreneurship, Dalian University of Technology(大连理工大学创新创业学院);School of Artificial Intelligence, Dalian University of Technology(大连理工大学人工智能学院)
SRMA-Mamba: Spatial Reverse Mamba Attention Network for Pathological Liver Segmentation in MRI Volumes
Chongqing University of Posts and Telecommunications(重庆邮电大学);Biomedical Perception & Intelligence Lab, University of South Dakota(南达科他大学生物医学感知与智能实验室);Aalto University(阿尔托大学);Malaviya National Institute of Technology Jaipur(马拉维亚国家理工学院斋浦尔分校);Machine & Hybrid Intelligence Lab, Northwestern University(西北大学机器与混合智能实验室)
Category Prompt Mamba Network for Nuclei Segmentation and Classification
School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)计算机科学与技术学院);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);School of Science, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)理学院);Pengcheng Laboratory(鹏城实验室)
HybridMamba: A Dual-domain Mamba for 3D Medical Image Segmentation
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Department of Radiology, Fudan University Shanghai Cancer Center(复旦大学上海肿瘤中心放射科);Department of Oncology, Shanghai Medical College, Fudan University(复旦大学上海医学院肿瘤科);The Hong Kong University of Science and Technology(香港科学与技术大学)
FU-Mamba: A Frequency-Enhanced Dynamic Scanning Framework for Oralscan Image Segmentation
School of Computer Science and Technology, Zhejiang Gongshang University(浙江工商大学计算机科学与技术学院);Tongxiang Hospital of Traditional Chinese Medicine(桐乡市中医院);Prince Sattam Bin Abdulaziz University(萨塔姆·本·阿卜杜勒阿齐兹王子大学);Qena University(奎纳大学);Tampere University(坦佩雷大学);Universidade Federal Fluminense(弗卢米嫩塞联邦大学);Federal University of Ceara(塞阿拉联邦大学);Firat University(菲拉特大学);Systems Research Institute, Polish Academy of Sciences(波兰科学院系统研究所);AGH University of Krakow(克拉科夫AGH大学)
BiSegMamba: Efficient Bidirectional Tri-Oriented Mamba for 3D Medical Image Segmentation
School of Computer Science and Engineering, Beihang University(北航计算机科学与工程学院);State Key Laboratory of Virtual Reality Technology and Systems, Beihang University(北航虚拟现实技术与系统国家重点实验室)
SwinMamba: A hybrid local-global mamba framework for enhancing semantic segmentation of remotely sensed images
Xi'an Jiaotong-Liverpool University(西交利物浦大学);University of Liverpool(利物浦大学);Nanyang Technological University(南洋理工大学);SJTUSME-COSMOPlat Joint Research Center for New Generation Industrial Intelligent Technology(上海交通大学机械与动力工程学院-卡奥斯新一代工业智能技术联合研究中心)