arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.09222cs.CRcs.AI
收藏

MUZZLE: 针对间接提示注入攻击的自适应智能体红队测试框架

MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks

Northeastern University(东北大学);Mozilla Corporation(Mozilla公司)

Georgios Syros, Evan Rose, Brian Grinstead, Christoph Kerschbaumer, William Robertson, Cristina Nita-Rotaru, Alina Oprea

AI总结:

提出MUZZLE框架,利用智能体轨迹自动识别高显著性注入面,自适应生成上下文相关的恶意指令,评估网络智能体对间接提示注入攻击的安全性,发现44种新攻击和跨应用攻击策略。

摘要:

基于大型语言模型的网络智能体正越来越多地被部署来自动化复杂的在线任务,通过直接与网站交互并代表用户执行操作。尽管这些智能体提供了强大的能力,但其设计使它们暴露于嵌入在不可信网络内容中的间接提示注入攻击,使对手能够劫持智能体行为并违反用户意图。尽管对这一威胁的认识日益增强,现有评估依赖于固定的攻击模板、手动选择的注入表面或范围狭窄的场景,限制了它们捕捉实际中遇到的现实自适应攻击的能力。我们提出了MUZZLE,一个自动化的智能体框架,用于评估网络智能体对间接提示注入攻击的安全性。MUZZLE利用智能体的轨迹自动识别高显著性注入表面,并自适应生成上下文相关的恶意指令,针对机密性、完整性和可用性的违反。与先前方法不同,MUZZLE根据观察到的智能体执行轨迹调整其攻击策略,并利用失败执行的反馈迭代改进攻击。我们在多种网络应用、用户任务和智能体配置上评估MUZZLE,展示了其以最少人工干预自动且自适应地评估网络智能体安全性的能力。我们的结果表明,MUZZLE在4个网络应用上针对10个违反机密性、可用性或隐私属性的对抗目标,在不同LLM和智能体框架下有效发现了44种新攻击。MUZZLE还识别了新颖的攻击策略,包括3种跨应用提示注入攻击和一种针对智能体的钓鱼场景。

英文摘要:

Large language model (LLM) based web agents are increasingly deployed to automate complex online tasks by directly interacting with web sites and performing actions on users' behalf. While these agents offer powerful capabilities, their design exposes them to indirect prompt injection attacks embedded in untrusted web content, enabling adversaries to hijack agent behavior and violate user intent. Despite growing awareness of this threat, existing evaluations rely on fixed attack templates, manually selected injection surfaces, or narrowly scoped scenarios, limiting their ability to capture realistic, adaptive attacks encountered in practice. We present MUZZLE, an automated agentic framework for evaluating the security of web agents against indirect prompt injection attacks. MUZZLE utilizes the agent's trajectories to automatically identify high-salience injection surfaces, and adaptively generate context-aware malicious instructions that target violations of confidentiality, integrity, and availability. Unlike prior approaches, MUZZLE adapts its attack strategy based on the agent's observed execution trajectory and iteratively refines attacks using feedback from failed executions. We evaluate MUZZLE across diverse web applications, user tasks, and agent configurations, demonstrating its ability to automatically and adaptively assess the security of web agents with minimal human intervention. Our results show that MUZZLE effectively discovers 44 new attacks on 4 web applications with 10 adversarial objectives that violate confidentiality, availability, or privacy properties across different LLMs and agent scaffolds. MUZZLE also identifies novel attack strategies, including 3 cross-application prompt injection attacks and an agent-tailored phishing scenario.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑