arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.16751cs.CRcs.AI
收藏

针对多种防御策略的自动化越狱攻击

Automated jailbreak attack targeting multiple defense strategies

East China Normal University(东华大学);Shanghai Innovation Institute(上海创新研究院);University of Southampton(南安普顿大学);Shanghai Jiao Tong University(上海交通大学);Software Engineering Institute, East China Normal University(东华大学软件工程研究院)

Qi Wang, Chengcheng Wan, Weijia He, Yanqing Li, Hanqi Sun, Xiaodong Gu, Jiangtao Wang

AI总结:

提出UNIATTACK框架,从防御视角提取攻击特征并优化,实现跨模型和类别的单次黑盒攻击,显著提升成功率并降低开销。

摘要:

大型语言模型(LLM)在广泛任务中展现出卓越能力。然而,由于其易受对抗性提示攻击,其安全性仍是关键问题。本文提出UNIATTACK,一个从防御视角设计的对抗性测试框架,用于系统性地构建有效的黑盒攻击提示。与依赖静态模板或迭代模型特定调优的先前方法不同,UNIATTACK从多种现有攻击中提取最小但高影响力的攻击特征,通过专门的攻击者LLM进行优化,并通过自动化精炼过程将其组合成灵活模板。这种以特征为中心的构建方式使得单次攻击能够泛化到多个模型和安全类别,为评估LLM鲁棒性提供了实用工具。我们的评估结果显示,与基线相比,UNIATTACK在部署了多层防御机制的模型上实现了平均攻击成功率(ASR)提升64.63%-248.82%,且仅消耗基线成本的0.03%-4.96%。UNIATTACK工件可在https://anonymous.4open.science/r/UniAttack-Artifact-30F1获取。

英文摘要:

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks. However, their safety remains a critical concern due to their susceptibility to adversarial prompt-based attacks. In this paper, we present UNIATTACK, an adversarial testing framework designed from a defense-oriented perspective to systematically construct effective black-box attack prompts. Unlike prior approaches that rely on static templates or iterative model-specific tuning, UNIATTACK extracts minimal but high-impact attack features from diverse existing attacks, optimizes them via a specialized attacker LLM, and composes them into flexible templates through automated refinement process. This feature-centric construction enables one-shot attacks that generalize across multiple models and safety categories, providing a practical tool for assessing LLM robustness. Our evaluation results shows that compared to the baselines, UNIATTACK achieves an average attack success rate (ASR) improvement of 64.63\%-248.82\% on models deployed with multi-layered defense mechanisms and it only takes 0.03\%-4.96\% cost of the baselines. UNIATTACK artifact is available at https://anonymous.4open.science/r/UniAttack-Artifact-30F1.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑