arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.08053cs.CVcs.AI

DynamicPAE:实时生成场景感知的物理对抗样本

DynamicPAE: Generating Scene-Aware Physical Adversarial Examples in Real-Time

State Key Laboratory of Complex & Critical Software Environment, Beihang University, Beijing, China(复杂与关键软件环境国家重点实验室,北京航空航天大学,北京,中国);Zhongguancun Lab(中关村实验室);ETH Zurich(苏黎世联邦理工学院)

Jin Hu, Xianglong Liu, Jiakai Wang, Junkai Zhang, Xianqi Yang, Haotong Qin, Yuqing Ma, Ke Xu

AI总结:

DynamicPAE提出首个场景感知实时物理对抗样本生成框架,通过残差引导探索和分布匹配对齐,在目标检测器上实现2.07倍攻击性能提升。

摘要:

物理对抗样本(PAEs)被视为深度学习应用中现实世界风险的吹哨人,因此值得进一步研究。然而,当前的PAE生成研究对多样且变化的场景表现出有限的自适应攻击能力,揭示了实时生成且以攻击者观察为条件的动态PAE的迫切需求。生成动态PAE的关键挑战在于,在攻击训练的噪声反馈下,学习PAE与攻击者观察之间的稀疏关系。为应对这一挑战,我们提出了DynamicPAE,这是首个能够实现场景感知实时物理攻击的生成框架。具体而言,为解决混淆场景相关PAE探索的噪声反馈问题,我们引入了残差引导的对抗模式探索技术。残差引导训练通过重构任务放宽攻击训练,旨在丰富反馈信息,从而实现对PAE更全面的探索。为解决训练生成器与真实世界场景之间的对齐问题,我们引入了分布匹配的攻击场景对齐,包括条件不确定性对齐数据模块和偏度对齐目标重加权模块。前者将训练环境与真实世界攻击者的不完整观察对齐。后者通过偏度控制器促进不同攻击目标间一致的隐蔽性控制。大量的数字和物理评估表明,DynamicPAE具有优越的攻击性能,在代表性目标检测器(如DETR)上,相较于最先进的静态PAE生成方法,实现了2.07倍的提升(攻击下平均AP下降58.8%)。总体而言,我们的工作为动态PAE的端到端建模打开了大门。

英文摘要:

Physical adversarial examples (PAEs) are regarded as whistle-blowers of real-world risks in deep-learning applications, thus worth further investigation. However, current PAE generation studies show limited adaptive attacking ability to diverse and varying scenes, revealing the urgent requirement of dynamic PAEs that are generated in real time and conditioned on the observation from the attacker. The key challenge in generating dynamic PAEs is learning the sparse relation between PAEs and the observation of attackers under the noisy feedback of attack training. To address the challenge, we present DynamicPAE, the first generative framework that enables scene-aware real-time physical attacks. Specifically, to address the noisy feedback problem that obfuscates the exploration of scene-related PAEs, we introduce the residual-guided adversarial pattern exploration technique. Residual-guided training, which relaxes the attack training with a reconstruction task, is proposed to enrich the feedback information, thereby achieving a more comprehensive exploration of PAEs. To address the alignment problem between the trained generator and the real-world scenario, we introduce the distribution-matched attack scenario alignment, consisting of the conditional-uncertainty-aligned data module and the skewness-aligned objective re-weighting module. The former aligns the training environment with the incomplete observation of the real-world attacker. The latter facilitates consistent stealth control across different attack targets with the skewness controller. Extensive digital and physical evaluations demonstrate the superior attack performance of DynamicPAE, attaining a 2.07 $\times$ boost (58.8% average AP drop under attack) on representative object detectors (e.g., DETR) over state-of-the-art static PAE generating methods. Overall, our work opens the door to end-to-end modeling of dynamic PAEs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑