Adversarial attacks in computer vision exploit the vulnerabilities of machine learning models by introducing subtle perturbations to input data, often leading to incorrect predictions or classifications. These attacks have evolved in sophistication with the advent of deep learning, presenting significant challenges in critical applications, which can be harmful for society. However, there is also a rich line of research from a transformative perspective that leverages adversarial techniques for social good. Specifically, we examine the rise of proactive schemes-methods that encrypt input data using additional signals termed templates, to enhance the performance of deep learning models. By embedding these imperceptible templates into digital media, proactive schemes are applied across various applications, from simple image enhancements to complicated deep learning frameworks to aid performance, as compared to the passive schemes, which don't change the input data distribution for their framework. The survey delves into the methodologies behind these proactive schemes, the encryption and learning processes, and their application to modern computer vision and natural language processing applications. Additionally, it discusses the challenges, potential vulnerabilities, and future directions for proactive schemes, ultimately highlighting their potential to foster the responsible and secure advancement of deep learning technologies.
Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecycle
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);School of Computing and Information Systems, University of Melbourne(墨尔本大学计算与信息系统学院);School of Computing and Information Systems, Singapore Management University(新加坡管理大学计算与信息系统学院);Institute of Trustworthy Embodied AI, Fudan University(复旦大学可信具身人工智能研究院);Department of Computer Science, School of Computing, Institute of Science Tokyo(东京科学大学计算学院计算机科学系);Sony AI(索尼人工智能公司)
Fight Perturbations with Perturbations: Defending Adversarial Attacks via Neuron Influence
College of Information Engineering at Zhejiang University of Technology(浙江工业大学信息工程学院);School of Cyber Science and Technology at Zhejiang University(浙江大学网络空间安全学院)
Watermark Vaccine: Adversarial Attacks to Prevent Watermark Removal
University of Chinese Academy of Sciences(中国科学院大学);Sun Yat-sen University(中山大学);Institute of Information Engineering, CAS(中国科学院信息工程研究所);Ant Group(蚂蚁集团);Tencent Security Zhuque Lab(腾讯安全朱雀实验室);University of Munich(慕尼黑大学)
LoRA Patching: Exposing the Fragility of Proactive Defenses against Deepfakes
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Electric Power Research Institute, China Southern Power Grid Company Ltd.(中国南方电网有限责任公司电力科学研究院)
RobotEQ-Video: A Video-Centric Benchmark for Social Proactive Intelligence with World-State Taxonomy
State Key Laboratory of Autonomous Intelligent Unmanned Systems, Tongji University(同济大学自主智能无人系统全国重点实验室);Tsinghua University(清华大学);The Chinese University of Hong Kong(香港中文大学);Shenzhen MSU-BIT University(深圳北理莫斯科大学);University of Science and Technology of China(中国科学技术大学)
Self-recoverable Adversarial Examples: A New Effective Protection Mechanism in Social Networks
Nanjing University of Information Science and Technology(南京信息工程大学);Nanjing University of Science and Technology(南京理工大学);State Key Laboratory of Mathematical Engineering and Advanced Computing(数学工程与先进计算国家重点实验室)
Proactive Adversarial Defense: Harnessing Prompt Tuning in Vision-Language Models to Detect Unseen Backdoored Images
University of West Florida(西佛罗里达大学);Florida Institute For Human and Machine Cognition (IHMC)(佛罗里达人机认知研究所);Center for Cybersecurity, University of West Florida(西佛罗里达大学网络安全中心)