arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2112.09151cs.CV
收藏

TAFIM:针对人脸图像操作的定向对抗攻击

TAFIM: Targeted Adversarial Attacks against Facial Image Manipulations

Technical University of Munich(慕尼黑工业大学);Sony Europe RDC Stuttgart(索尼欧洲研发中心斯图加特分部)

Shivangi Aneja, Lev Markhasin, Matthias Niessner

摘要:

面部操纵方法可能被滥用,以影响个人的隐私或传播虚假信息。为此,我们引入了一种新的数据驱动的方法,产生嵌入在原始图像中的图像特定的扰动。关键的想法是,这些受保护的图像通过使操纵模型产生预定义的操纵目标(在我们的情况下是均匀着色的输出图像)而不是实际操纵来防止面部操纵。此外,我们建议利用可微压缩近似,从而使生成的扰动强大的常见的图像压缩。为了防止多个操作方法同时进行,我们进一步提出了一种新的基于注意力的融合操作特定的扰动。与单独优化每个图像的噪声模式的传统对抗攻击相比,我们的广义模型只需要一个前向传递,从而更快地运行数量级,并允许轻松集成在图像处理堆栈中,即使在智能手机等资源受限的设备上。

英文摘要:

Face manipulation methods can be misused to affect an individual's privacy or to spread disinformation. To this end, we introduce a novel data-driven approach that produces image-specific perturbations which are embedded in the original images. The key idea is that these protected images prevent face manipulation by causing the manipulation model to produce a predefined manipulation target (uniformly colored output image in our case) instead of the actual manipulation. In addition, we propose to leverage differentiable compression approximation, hence making generated perturbations robust to common image compression. In order to prevent against multiple manipulation methods simultaneously, we further propose a novel attention-based fusion of manipulation-specific perturbations. Compared to traditional adversarial attacks that optimize noise patterns for each image individually, our generalized model only needs a single forward pass, thus running orders of magnitude faster and allowing for easy integration in image processing stacks, even on resource-constrained devices like smartphones.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑