FOCA: Frequency-Oriented Cross-Domain Forgery Detection, Localization and Explanation via Multi-Modal Large Language Model
Harbin Institute of Technology(哈尔滨工业大学);DZ-Matrix;Guangdong Laboratory of Artificial Intelligence and Digital Economy(广东省人工智能与数字经济实验室);Chongqing Research Institute of HIT(哈尔滨工业大学重庆研究院);University of New South Wales(新南威尔士大学)
Zhou Liu, Tonghua Su, Hongshi Zhang, Fuxiang Yang, Donglin Di, Yang Song, Lei Fan
Advances in image tampering techniques, particularly generative models, pose significant challenges to media verification, digital forensics, and public trust. Existing image forgery detection and localization (IFDL) methods suffer from two key limitations: over-reliance on semantic content while neglecting textural cues, and limited interpretability of subtle low-level tampering traces. To address these issues, we propose FOCA, a multimodal large language model-based framework that integrates discriminative features from both the RGB spatial and frequency domains via a cross-attention fusion module. This design enables accurate forgery detection and localization while providing explicit, human-interpretable cross-domain explanations. We further introduce FSE-Set, a large-scale dataset with diverse authentic and tampered images, pixel-level masks, and dual-domain annotations. Extensive experiments show that FOCA outperforms state-of-the-art methods in detection performance and interpretability across both spatial and frequency domains.
Rethinking Image Forgery Detection via Soft Contrastive Learning and Unsupervised Clustering
School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);Guangdong Key Laboratory of Intelligent Information Processing, College of Electronics and Information Engineering, Shenzhen University(广东智能信息处理重点实验室、电子与信息工程学院)
FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models
School of Electronic and Computer Engineering, Peking University(北京大学电子与计算机工程学院);Peking University Shenzhen Graduate School(北京大学深圳研究生院);Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology(广东省超高清沉浸式媒体技术重点实验室);School of Future Technology, South China University of Technology(华南理工大学未来技术学院)
Generating Attribution Reports for Manipulated Facial Images: A Dataset and Baseline
Xi’an Jiaotong University(西安交通大学);Hefei University of Technology(合肥工业大学);CSIRO(澳大利亚联邦科学与工业研究组织);Northwestern Polytechnical University(西北工业大学);University of Macau(澳门大学)
HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding
University of Chicago(芝加哥大学);Massachusetts Institute of Technology(麻省理工学院);UNC-Chapel Hill(北卡罗来纳大学教堂山分校);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Toyota Technological Institute at Chicago(芝加哥丰田理工学院)
MFCLIP: Multi-modal Fine-grained CLIP for Generalizable Diffusion Face Forgery Detection
Faculty of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences)(计算机科学与技术学院,齐鲁工业大学(山东科学院));School of Computing, National University of Singapore(computing 学院,新加坡国立大学);School of Computing and Information Technology, Great Bay University(computing 与信息学院,大湾大学);National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University(大数据系统计算技术国家工程实验室,深圳大学)
CAM-VFD: Cross-Attention Multimodal Video Forgery Detection
Computer Engineering Department, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport(计算机工程系,工程与技术学院,阿拉伯科学、技术与海运交通学院)
OmniVL-Guard: Towards Unified Vision-Language Forgery Detection and Grounding via Balanced RL
School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, China(合肥工业大学计算机科学与信息工程学院);Wuhan University, Wuhan, China(武汉大学);Lab for Intelligence and visiON (LION)(智能视觉实验室)
A Unified Attention U-Net Framework for Cross-Modality Tumor Segmentation in MRI and CT
Department of Computer Science, New Mexico State University(计算机科学系,新墨西哥州立大学);Department of Plant and Environmental Sciences, New Mexico State University(植物与环境科学系,新墨西哥州立大学)
Towards Generalizable Deepfake Detection via Forgery-aware Audio-Visual Adaptation: A Variational Bayesian Approach
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Department of New Networks, Pengcheng Laboratory(鹏城实验室网络部);School of Cyber Science and Technology, Sun Yat-sen University(中山大学网络安全科学与技术学院);School of Computer Science and Cyber Engineering, Guangzhou University(广州大学计算机科学与网络工程学院);School of Cyberspace Science, Harbin Institute of Technology(哈尔滨工业大学网络空间科学学院)
Unleashing the Potential of Consistency Learning for Detecting and Grounding Multi-Modal Media Manipulation
MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所MAIS);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);CAIR, HKISI, Chinese Academy of Sciences(中国科学院计算机辅助研究部);School of Computer Science and Engineering, the Faculty of Innovation Engineering, M.U.S.T(慕斯科技大学计算机科学与工程学院);Sangfor Technologies Inc.(Sangfor技术有限公司);Beijing Jiaotong University(北京交通大学);Alibaba Group(阿里巴巴集团)
A Multimodal Deviation Perceiving Framework for Weakly-Supervised Temporal Forgery Localization
School of Computer Science and Engineering, Sun Yat-sen University(计算机科学与工程学院,中山大学);State Key Laboratory of Mathematical Engineering and Advanced Computing(数学工程与先进计算国家重点实验室);School of Cyber Science and Engineering, Wuhan University(网络科学与工程学院,武汉大学)
CorrDetail: Visual Detail Enhanced Self-Correction for Face Forgery Detection
School of Software Technology, Zhejiang University(浙江大学软件学院);Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);School of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Ant Group(蚂蚁集团);School of Computer Science and Technology, Zhejiang University of Technology(浙江工业大学计算机科学与技术学院)
MM-VeriAgent: Learning to Use Extensive Tools to Verify Multimodal Misinformation with Reinforcement Learning
Beijing University of Posts and Telecommunications(北京邮电大学);Minzu University of China(中央民族大学);NLPR, Institute of automation, Chinese academy of science, Chinese Academy of Sciences(中国科学院自动化研究所模式识别国家重点实验室)
MFVLR: Multi-domain Fine-grained Vision-Language Reconstruction for Generalizable Diffusion Face Forgery Detection and Localization
Faculty of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences)(计算机科学与技术学院,齐鲁工业大学(山东省科学院));School of Computing, National University of Singapore(国立新加坡大学计算机学院);Shandong Artificial Intelligence Institute, Qilu University of Technology (Shandong Academy of Sciences)(山东省人工智能研究院,齐鲁工业大学(山东省科学院));Key Laboratory of Computer Vision and System, Ministry of Education, Tianjin University of Technology(教育部计算机视觉与系统重点实验室,天津工业大学)
FoCal: Frequency-Oriented Cross-Modal Interaction and Spectral Calibration for Aerial Visible-Infrared Object Detection
Nanjing University of Science and Technology(南京理工大学);Shanghai Institute of Technical Physics, Chinese Academy of Sciences(中国科学院上海技术物理研究所);China Electronics Technology Group Corporation(中国电子科技集团公司)
Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Models
The University of Hong Kong(香港大学);HKU Shanghai Intelligent Computing Research Center(港大上海智能计算研究中心);Shanghai AI Laboratory(上海人工智能实验室);Zhejiang Laboratory(浙江实验室);Hangzhou Institute for Advanced Study(杭州高等研究院);Zhejiang University(浙江大学);Alibaba(阿里巴巴);MEGVII Technology(旷视科技)
AIGC Video Detection based on the fusion of spatial-frequency-optical flow multimodal features
Beihang University(北京航空航天大学);Nanchang University(南昌大学);DBAPPSecurity Co., Ltd. (DAS-Security)(杭州安恒信息技术股份有限公司);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
Weakly Supervised Multimodal Temporal Forgery Localization via Multitask Learning
School of Computer Science and Engineering, MoE Key Laboratory of Information Technology, Guangdong Province Key Laboratory of Information Security Technology, Sun Yat-sen University(计算机科学与工程学院、信息科技教育部重点实验室、广东省信息安全技术重点实验室、中山大学);State Key Laboratory of Mathematical Engineering and Advanced Computing(数学工程与先进计算国家重点实验室)
SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);Department of Artificial Intelligence, Xiamen University(厦门大学人工智能系);School of Information Science and Technology, Shijiazhuang Tiedao University(石家庄铁道大学信息科学与技术学院);Electrical Engineering Department, UCLA(加州大学洛杉矶分校电子工程系);New Laboratory of Pattern Recognition(NLPR), Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所模式识别新实验室);College of Electronics and Information Engineering, Shenzhen University(深圳大学电子与信息工程学院);School of Computing and Information Technology, Great Bay University(广东东莞Great Bay大学计算与信息科技学院);School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区网络科学与技术学院)