Can Visual Mamba Improve AI-Generated Image Detection? An In-Depth Investigation
Laboratory of IEMN, CNRS, Centrale Lille, UMR 8520, Univ. Polytechnique Hauts-de-France(伊姆纳实验室,国家科学研究中心,里尔中央理工大学,UMR 8520,法国高等技术大学);Khalifa University(卡利法大学);School of Communication and Information Engineering, Shanghai University(上海大学通信与信息工程学院);Sorbonne Center for Artificial Intelligence, Sorbonne University Abu Dhabi(索邦人工智能中心,索邦大学阿布扎克分校)
In recent years, computer vision has witnessed remarkable progress, fueled by the development of innovative architectures such as Convolutional Neural Networks (CNNs), Generative Adversarial Networks (GANs), diffusion-based architectures, Vision Transformers (ViTs), and, more recently, Vision-Language Models (VLMs). This progress has undeniably contributed to creating increasingly realistic and diverse visual content. However, such advancements in image generation also raise concerns about potential misuse in areas such as misinformation, identity theft, and threats to privacy and security. In parallel, Mamba-based architectures have emerged as versatile tools for a range of image analysis tasks, including classification, segmentation, medical imaging, object detection, and image restoration, in this rapidly evolving field. However, their potential for identifying AI-generated images remains relatively unexplored compared to established techniques. This study provides a systematic evaluation and comparative analysis of Vision Mamba models for AI-generated image detection. We benchmark multiple Vision Mamba variants against representative CNNs, ViTs, and VLM-based detectors across diverse datasets and synthetic image sources, focusing on key metrics such as accuracy, efficiency, and generalizability across diverse image types and generative models. Through this comprehensive analysis, we aim to elucidate Vision Mamba's strengths and limitations relative to established methodologies in terms of applicability, accuracy, and efficiency in detecting AI-generated images. Overall, our findings highlight both the promise and current limitations of Vision Mamba as a component in systems designed to distinguish authentic from AI-generated visual content. This research is crucial for enhancing detection in an age where distinguishing between real and AI-generated content is a major challenge.
OPa-Ma: Text Guided Mamba for 360-degree Image Out-painting
Cleveland Clinic(克利夫兰诊所);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);East China Normal University(华东师范大学);Solon High School(索伦高中);Tianyuan Biotechnology(天元生物科技)
Mamba-Enhanced Implicit Motion Learning for Audio-Driven Portrait Animation
Fujian Provincial Natural Science Foundation of China(福建省自然科学基金委员会);Giant Interactive Group Inc.(巨匠互动集团有限公司);National Natural Science Foundation of China(国家自然科学基金委员会)
Tree-Mamba: A Tree-Aware Mamba for Underwater Monocular Depth Estimation
Key Laboratory of Knowledge Automation for Industrial Processes, Ministry of Education(知识自动化工业过程关键实验室,教育部);School of Automation and Electrical Engineering, University of Science and Technology Beijing(北京科技大学自动化与电气工程学院);School of Ophthalmology and Optometry, Wenzhou Medical University(温州医科大学眼视光学院);Department of Automation, Tsinghua University(清华大学自动化系);Deepinfar Ocean Technology Inc.(深海远航技术有限公司);School of Data Science, Lingnan University(岭南大学数据科学学院);College of Computer Science, Nankai University(南开大学计算机学院)
Automotive Software Innovation Center(汽车软件创新中心);Institute of Intelligent Software(智能软件研究所);Saarland University(萨尔大学);Hangzhou Institute for Advanced Study(杭州高等研究院);University of Chinese Academy of Sciences(中国科学院大学);University of Science and Technology of China(中国科学技术大学)
AVS-Mamba: Exploring Temporal and Multi-modal Mamba for Audio-Visual Segmentation
School of Information and Communication Engineering, Dalian University of Technology(大连理工大学信息与通信工程学院);School of Innovation and Entrepreneurship, Dalian University of Technology(大连理工大学创新创业学院);School of Artificial Intelligence, Dalian University of Technology(大连理工大学人工智能学院)
MambaHash: Visual State Space Deep Hashing Model for Large-Scale Image Retrieval
School of Computer Science, Inner Mongolia University, Provincial Key Laboratory of Mongolian Information Processing Technology, National and Local Joint Engineering Research Center of Mongolian Information Processing(内蒙古大学计算机学院、蒙古信息处理技术省级重点实验室、蒙古信息处理国家与地方联合工程研究中心)
CMAMBADEPTH: Self-supervised Monocular Depth Estimation with Channel Mamba and Hybrid Attention
Harbin Engineering University(哈尔滨工程大学);Key Laboratory of Advanced Marine Communication and Information Technology(先进海洋通信与信息技术重点实验室);University of Toronto(多伦多大学);Kanagawa University(神奈川大学)
MiM-ISTD: Mamba-in-Mamba for Efficient Infrared Small Target Detection
Chinese Academy of Sciences(中国科学院);University of Science and Technology of China(中国科学技术大学);Institute of Intelligent Software(智能软件研究所);Alibaba Cloud(阿里云)
MambaEVT: Event Stream based Visual Object Tracking using State Space Model
School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院);School of Artificial Intelligence, Anhui University(安徽大学人工智能学院);Beijing Institute of Technology(北京理工大学)
MambaTrans: Multimodal Fusion Image Translation via Large Language Model Priors for Downstream Visual Tasks
School of Physics and Optoelectronic Engineering(物理与光电工程学院);Guangdong-HongKong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology(粤港澳联合智能微纳光电技术实验室);School of Information Engineering and Automation(信息工程与自动化学院)
本文提出MambaTrans,一种多模态融合图像模态翻译器,利用多模态大语言模型描述和语义分割掩码作为输入,通过Multi-Model State Space Block捕获跨模态依赖,在不调整预训练模型参数的情况下提升下游视觉任务性能。
VIMCAN: Visual-Inertial 3D Human Pose Estimation with Hybrid Mamba-Cross-Attention Network
Beihang University(北航);Peng Cheng Laboratory(鹏城实验室);Capital University of Physical Education and Sports(首都体育学院);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)
DensePercept-NCSSD: Vision Mamba towards Real-time Dense Visual Perception with Non-Causal State Space Duality
Machine Intelligence Group, Department of Computer Science & Information Systems, Birla Institute of Technology and Science, Pilani, Hyderabad Campus(机器智能组,计算机科学与信息系统系,比拉理工学院,帕利尼,海得拉巴校区)
EMMA: Empowering Multi-modal Mamba with Structural and Hierarchical Alignment
Peng Cheng Laboratory(鹏城实验室);University of Chinese Academy of Sciences(中国科学院大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Sun Yat-sen University(中山大学)
NeuroMamba: Multi-Perspective Feature Interaction with Visual Mamba for Neuron Segmentation
State Key Laboratory of Brain Cognition and Brain-Inspired Intelligence Technology, Institute of Automation, Chinese Academy of Sciences(脑认知与脑启发智能技术国家重点实验室,自动化研究所)
School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院);School of Electronic and Information Engineering, Anhui University(安徽大学电子与信息工程学院)
Combining traditional RGB cameras with bio-inspired event cameras for robust object tracking has garnered increasing attention in recent years. However, most existing multimodal tracking algorithms depend heavily on high-complexity Vision Transformer architectures for feature extraction and fusion across modalities. This not only leads to substantial computational overhead but also limits the effectiveness of cross-modal interactions. In this paper, we propose an efficient RGB-Event object tracking framework based on the linear-complexity Vision Mamba network, termed Mamba-FETrack V2. Specific…