CAHS-攻击:针对稳定扩散模型的CLIP感知启发式搜索攻击方法
CAHS-Attack: CLIP-Aware Heuristic Search Attack Method for Stable Diffusion
AI总结:
CAHS-攻击通过CLIP感知的启发式搜索方法,针对稳定扩散模型的文本编码器漏洞,实现高效对抗性提示生成,提升生成模型的安全性。
摘要:
扩散模型在面对对抗性提示时表现出显著的脆弱性,增强攻击能力对于揭示此类漏洞和构建更稳健的生成系统至关重要。现有研究往往依赖于对模型梯度的白盒访问或手工设计的提示工程,但在现实部署中由于访问受限或攻击效果不佳,这种做法不可行。本文提出CAHS-攻击,一种CLIP感知的启发式搜索攻击方法。CAHS-攻击整合了蒙特卡洛树搜索(MCTS)以执行细粒度后缀优化,利用受约束的遗传算法预先选择高潜力的对抗性提示作为根节点,并在每次模拟滚动中保留最语义破坏性的结果以实现高效的局部搜索。广泛的实验表明,我们的方法在各种语义的短和长提示上均实现了最先进的攻击性能。此外,我们发现SD模型的脆弱性可以归因于其基于CLIP的文本编码器的内在脆弱性,这表明当前文本到图像管道存在根本性的安全风险。
英文摘要:
Diffusion models exhibit notable fragility when faced with adversarial prompts, and strengthening attack capabilities is crucial for uncovering such vulnerabilities and building more robust generative systems. Existing works often rely on white-box access to model gradients or hand-crafted prompt engineering, which is infeasible in real-world deployments due to restricted access or poor attack effect. In this paper, we propose CAHS-Attack , a CLIP-Aware Heuristic Search attack method. CAHS-Attack integrates Monte Carlo Tree Search (MCTS) to perform fine-grained suffix optimization, leveraging a constrained genetic algorithm to preselect high-potential adversarial prompts as root nodes, and retaining the most semantically disruptive outcome at each simulation rollout for efficient local search. Extensive experiments demonstrate that our method achieves state-of-the-art attack performance across both short and long prompts of varying semantics. Furthermore, we find that the fragility of SD models can be attributed to the inherent vulnerability of their CLIP-based text encoders, suggesting a fundamental security risk in current text-to-image pipelines.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。