面向不可感知的对抗防御:一种针对人脸篡改的梯度驱动护盾
Towards Imperceptible Adversarial Defense: A Gradient-Driven Shield against Facial Manipulations
AI总结:
针对人脸深度伪造主动防御中不可感知性与防御效果难兼顾、损失间梯度冲突削弱性能的问题,提出GRASP方法,通过梯度投影机制平衡优化,实现高视觉质量下的100%防御成功率。
摘要:
随着生成模型的蓬勃发展,篡改人脸图像的获取门槛越来越低,引发了人们对隐私侵犯和社会信任的担忧。对此,主动防御策略将对抗扰动嵌入人脸图像,以对抗深度伪造(deepfake)篡改。然而,现有方法往往需要在不可感知性和防御效果之间权衡——强扰动或许能破坏伪造效果,但会降低视觉保真度。近期研究尝试通过引入额外的视觉损失约束来解决这一问题,但往往忽略了不同损失之间潜在的梯度冲突,最终削弱了防御性能。为弥补这一不足,我们提出了一种基于梯度投影的对抗主动防御方法GRASP,可在最小化感知退化的同时有效对抗人脸深度伪造。GRASP是首个成功整合结构相似性损失与低频损失以提升扰动不可感知性的方法。通过分析防御效果损失与视觉质量损失之间的梯度冲突,GRASP开创性地设计了梯度投影机制来缓解这些冲突,实现了在不牺牲防御性能的前提下保留图像保真度的均衡优化。大量实验验证了GRASP的有效性:其峰值信噪比(PSNR)超过40 dB,结构相似性指数(SSIM)达0.99,针对人脸属性篡改的防御成功率为100%,在视觉质量上显著优于现有方法。
英文摘要:
With the flourishing prosperity of generative models, manipulated facial images have become increasingly accessible, raising concerns regarding privacy infringement and societal trust. In response, proactive defense strategies embed adversarial perturbations into facial images to counter deepfake manipulation. However, existing methods often face a tradeoff between imperceptibility and defense effectiveness-strong perturbations may disrupt forgeries but degrade visual fidelity. Recent studies have attempted to address this issue by introducing additional visual loss constraints, yet often overlook the underlying gradient conflicts among losses, ultimately weakening defense performance. To bridge the gap, we propose a gradient-projection-based adversarial proactive defense (GRASP) method that effectively counters facial deepfakes while minimizing perceptual degradation. GRASP is the first approach to successfully integrate both structural similarity loss and low-frequency loss to enhance perturbation imperceptibility. By analyzing gradient conflicts between defense effectiveness loss and visual quality losses, GRASP pioneers the design of the gradient-projection mechanism to mitigate these conflicts, enabling balanced optimization that preserves image fidelity without sacrificing defensive performance. Extensive experiments validate the efficacy of GRASP, achieving a PSNR exceeding 40 dB, SSIM of 0.99, and a 100% defense success rate against facial attribute manipulations, significantly outperforming existing approaches in visual quality.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。