Many physical adversarial patch generation methods are widely proposed to protect personal privacy from malicious monitoring using object detectors. However, they usually fail to generate satisfactory patch images in terms of both stealthiness and attack performance without making huge efforts on careful hyperparameter tuning. To address this issue, we propose a novel naturalistic adversarial patch generation method based on the diffusion models (DM). Through sampling the optimal image from the DM model pretrained upon natural images, it allows us to stably craft high-quality and naturalistic physical adversarial patches to humans without suffering from serious mode collapse problems as other deep generative models. To the best of our knowledge, we are the first to propose DM-based naturalistic adversarial patch generation for object detectors. With extensive quantitative, qualitative, and subjective experiments, the results demonstrate the effectiveness of the proposed approach to generate better-quality and more naturalistic adversarial patches while achieving acceptable attack performance than other state-of-the-art patch generation methods. We also show various generation trade-offs under different conditions.
FZI Research Center for Information Technology(FZI信息技术研究中心);Karlsruhe Institute of Technology (KIT)(卡尔斯鲁厄理工学院)
Standard approaches for adversarial patch generation lead to noisy conspicuous patterns, which are easily recognizable by humans. Recent research has proposed several approaches to generate naturalistic patches using generative adversarial networks (GANs), yet only a few of them were evaluated on the object detection use case. Moreover, the state of the art mostly focuses on suppressing a single large bounding box in input by overlapping it with the patch directly. Suppressing objects near the patch is a different, more complex task. In this work, we have evaluated the existing approaches to g…
PAD: Patch-Agnostic Defense against Adversarial Patch Attacks
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区网络空间安全学院)
The University of Adelaide(阿德莱德大学);Rutgers University(罗格斯大学)
Deep neural networks are vulnerable to attacks from adversarial inputs and, more recently, Trojans to misguide or hijack the model's decision. We expose the existence of an intriguing class of spatially bounded, physically realizable, adversarial examples -- Universal NaTuralistic adversarial paTches -- we call TnTs, by exploring the superset of the spatially bounded adversarial example space and the natural input space within generative adversarial networks. Now, an adversary can arm themselves with a patch that is naturalistic, less malicious-looking, physically realizable, highly effective …
Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Models
Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);National University of Singapore(新加坡国立大学);Guangdong Testing Institute of Product Quality Supervision(广东省产品质量监督检验研究院)
Physical Evaluation of Naturalistic Adversarial Patches for Camera-Based Traffic-Sign Detection
Department of Computing Sciences, University of Hartford(计算科学系,哈特福大学);Department of Electrical and Computer Engineering, Tennessee Technological University(电气与计算机工程系,田纳西技术大学);Center for Manufacturing Research, Tennessee Technological University(制造研究中心,田纳西技术大学)
Jedi: Entropy-based Localization and Removal of Adversarial Patches
Université de Sousse(苏塞大学);Ecole Nationale d’Ingénieurs de Sousse(苏塞国家工程师学院);University of California Riverside(加州大学河滨分校);Queen’s University Belfast(贝尔法斯特女王大学);CNRS(法国国家科学研究中心);Université Polytechnique Hauts-de-France(上法兰西综合理工大学);Université de Jendouba(坚杜巴大学);Institut National des Technologies et des Sciences du Kef(卡夫国家技术与科学学院)
RISE Research Institutes of Sweden(瑞典RISE研究机构);KTH Royal Institute of Technology(KTH皇家理工学院);CISPA Helmholtz Center for Information Security(CISPA亥姆霍兹信息安全研究中心);Halmstad University(哈尔姆斯塔德大学)
OP4KSR: One-Step Patch-Free 4K Super-Resolution with Periodic Artifact Suppression
School of Automation Engineering, University of Electronic Science and Technology of China(电子科技大学自动化工程学院);OPPO AI Center, OPPO Inc.(OPPO人工智能中心);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院)
Beijing University(北京大学);Beijing University of Posts and Telecommunications(北京邮电大学)
Image inpainting technology can patch images with missing pixels. Existing methods propose convolutional neural networks to repair corrupted images. The networks focus on the valid pixels around the missing pixels, use the encoder-decoder structure to extract valuable information, and use the information to fix the vacancy. However, if the missing part is too large to provide useful information, the result will exist blur, color mixing, and object confusion. In order to patch the large hole image, we study the existing approaches and propose a new network, the compression-decompression network…