arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.03598cs.CR
收藏

AttackEval: 一种针对大语言模型的提示注入攻击有效性系统性实证研究

AttackEval: A Systematic Empirical Study of Prompt Injection Attack Effectiveness Against Large Language Models

Jackson Wang

AI总结:

AttackEval系统性研究提示注入攻击有效性,揭示了Obfuscation攻击在对抗意图感知防御时的成功率最高,以及复合攻击策略显著提升攻击成功率,为改进大语言模型安全系统提供指导。

摘要:

提示注入已成为大语言模型(LLM)部署中的关键漏洞,但现有研究侧重于防御方法。AttackEval通过构建包含10种攻击类别的分类体系,设计250个精心设计的提示,并在四个逐步增强的防御层级上评估其有效性。实验揭示了Obfuscation攻击在对抗意图感知防御时的成功率最高,以及复合攻击策略显著提升攻击成功率,为改进大语言模型安全系统提供指导。

英文摘要:

Prompt injection has emerged as a critical vulnerability in large language model (LLM) deployments, yet existing research is heavily weighted toward defenses. The attack side -- specifically, which injection strategies are most effective and why -- remains insufficiently studied.We address this gap with AttackEval, a systematic empirical study of prompt injection attack effectiveness. We construct a taxonomy of ten attack categories organized into three parent groups (Syntactic, Contextual, and Semantic/Social), populate each category with 25 carefully crafted prompts (250 total), and evaluate them against a simulated production victim system under four progressively stronger defense tiers. Experiments reveal several non-obvious findings: (1) Obfuscation (OBF) achieves the highest single-attack success rate (ASR = 0.76) against even intent-aware defenses, because it defeats both keyword matching and semantic similarity checks simultaneously; (2) Semantic/Social attacks - Emotional Manipulation (EM) and Reward Framing (RF) - maintain high ASR (0.44-0.48) against intent-aware defenses due to their natural language surface, which evades structural anomaly detection; (3) Composite attacks combining two complementary strategies dramatically boost ASR, with the OBF + EM pair reaching 97.6%; (4) Stealth correlates positively with residual ASR against semantic defenses (r = 0.71), implying that future defenses must jointly optimize for both structural and behavioral signals. Our findings identify concrete blind spots in current defenses and provide actionable guidance for designing more robust LLM safety systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑