Finding tampered regions in images is a hot research topic in machine learning and computer vision. Although many image manipulation location algorithms have been proposed, most of them only focus on the RGB images with different color spaces, and the frequency information that contains the potential tampering clues is often ignored. In this work, a novel end-to-end two-stream boundary-aware network (abbreviated as TBNet) is proposed for generic image manipulation localization in which the RGB stream, the frequency stream, and the boundary artifact location are explored in a unified framework. Specifically, we first design an adaptive frequency selection module (AFS) to adaptively select the appropriate frequency to mine inconsistent statistics and eliminate the interference of redundant statistics. Then, an adaptive cross-attention fusion module (ACF) is proposed to adaptively fuse the RGB feature and the frequency feature. Finally, the boundary artifact location network (BAL) is designed to locate the boundary artifacts for which the parameters are jointly updated by the outputs of the ACF, and its results are further fed into the decoder. Thus, the parameters of the RGB stream, the frequency stream, and the boundary artifact location network are jointly optimized, and their latent complementary relationships are fully mined. The results of extensive experiments performed on four public benchmarks of the image manipulation localization task, namely, CASIA1.0, COVER, Carvalho, and In-The-Wild, demonstrate that the proposed TBNet can significantly outperform state-of-the-art generic image manipulation localization methods in terms of both MCC and F1.
UniWAM Technical Report: Unified Mobile Manipulation via Mixed-Stream World-Action Modeling and Manipulation Anchor Pose Supervision
Physical Superintelligence Lab, Fysics AI(Fysics AI 物理超级智能实验室);College of Intelligent Robotics and Advanced Manufacturing, Fudan University(复旦大学智能机器人与先进制造学院)
The Courtroom Trial of Pixels: Robust Image Manipulation Localization via Adversarial Evidence and Reinforcement Learning Judgment
School of Computer Science and Technology, Xinjiang University(新疆大学计算机科学与技术学院);Ant Group(蚂蚁集团);College of Computer Science and Electronic Engineering, Hunan University(湖南大学计算机科学与电子工程学院)
Pixel-Inconsistency Modeling for Image Manipulation Localization
Nanyang Technology University(南洋理工大学);School of Electrical and Electronic Engineering(电子电气工程学院);Rapid-Rich Object Search (ROSE) Lab(快速富对象搜索实验室);School of Computer Science and Engineering(计算机科学与工程学院);Sun Yat-sen University(中山大学);City University of Hong Kong(香港城市大学);University of Campinas(坎皮纳斯大学);Institute of Computing(计算机研究所);Artificial Intelligence Laboratory (Recod.ai)(人工智能实验室(Recod.ai))
AnyFace: Free-style Text-to-Face Synthesis and Manipulation
Center for Research on Intelligent Perception and Computing, NLPR, CASIA(中国科学院自动化研究所模式识别国家重点实验室智能感知与计算研究中心);School of Artificial Intelligence, University of Chinese Academy of Sciences (UCAS)(中国科学院大学人工智能学院)
Two-stream Encoder-Decoder Network for Localizing Image Forgeries
Indian Institute of Technology Guwahati(印度理工学院古瓦哈蒂分校);Department of Electronics and Electrical Engineering(电子与电气工程系);Department of Electronics and Electrical Engineering, Indian Institute of Technology Guwahati(电子与电气工程系,印度理工学院古瓦哈蒂分校);Indian Institute of Technology Guwahati, Assam-781039, India(印度理工学院古瓦哈蒂分校,印度阿萨姆邦-781039)
DeepAgent: A Dual Stream Multi Agent Fusion for Robust Multimodal Deepfake Detection
Applied Artificial Intelligence and Intelligent Systems (AAIINS) Laboratory(应用人工智能与智能系统实验室);Department of Computer Science and Engineering(计算机科学与工程系);University of Scholars(学者大学);Faculty of Science and Information Technology(科学与信息技术学院);Faculty of Science and Technology(科学与技术学院)
Fooling the primate brain with minimal, targeted image manipulation
Harvard Medical School(哈佛医学院);National University of Singapore(新加坡国立大学);Harvard University(哈佛大学);Boston Children’s Hospital(波士顿儿童医院);Center for Brains, Minds and Machines(大脑、心智与机器中心)
AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulation
The University of Hong Kong(香港大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Peking University(北京大学);The Chinese University of Hong Kong(香港中文大学);National University of Singapore(新加坡国立大学);Knowin AI(考拉悠然科技)