arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2307.08076cs.CV
收藏

从扩散到困惑:基于扩散模型的面向目标检测器的自然对抗补丁生成

Diffusion to Confusion: Naturalistic Adversarial Patch Generation Based on Diffusion Model for Object Detector

National Central University(中央大学);Research Center for Information Technology Innovation, Academia Sinica(中央研究院资讯科技创新研究中心)

Shuo-Yen Lin, Ernie Chu, Che-Hsien Lin, Jun-Cheng Chen, Jia-Ching Wang

AI总结:

针对物理对抗补丁难以兼顾隐蔽性与攻击效果的问题,提出基于预训练扩散模型采样的自然对抗补丁生成方法,并通过实验验证其质量、自然性与攻击有效性。

摘要:

许多物理对抗补丁生成方法被广泛提出,以保护个人隐私免受使用目标检测器的恶意监控。然而,它们通常无法在隐蔽性和攻击性能两方面生成令人满意的补丁图像,除非在细致的超参数调优上付出巨大努力。为解决这一问题,我们提出一种基于扩散模型(DM)的新型自然对抗补丁生成方法。通过从在自然图像上预训练的 DM 模型中采样最优图像,该方法使我们能够稳定地制作对人类而言高质量且自然的物理对抗补丁,而不会像其他深度生成模型那样遭受严重的模式崩溃问题。据我们所知,我们是首个提出面向目标检测器的、基于 DM 的自然对抗补丁生成方法的研究者。通过大量定量、定性和主观实验,结果表明,与其他最先进的补丁生成方法相比,所提方法能生成质量更好、更自然的对抗补丁,同时实现可接受的攻击性能。我们还展示了不同条件下的多种生成权衡。

英文摘要:

Many physical adversarial patch generation methods are widely proposed to protect personal privacy from malicious monitoring using object detectors. However, they usually fail to generate satisfactory patch images in terms of both stealthiness and attack performance without making huge efforts on careful hyperparameter tuning. To address this issue, we propose a novel naturalistic adversarial patch generation method based on the diffusion models (DM). Through sampling the optimal image from the DM model pretrained upon natural images, it allows us to stably craft high-quality and naturalistic physical adversarial patches to humans without suffering from serious mode collapse problems as other deep generative models. To the best of our knowledge, we are the first to propose DM-based naturalistic adversarial patch generation for object detectors. With extensive quantitative, qualitative, and subjective experiments, the results demonstrate the effectiveness of the proposed approach to generate better-quality and more naturalistic adversarial patches while achieving acceptable attack performance than other state-of-the-art patch generation methods. We also show various generation trade-offs under different conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑