arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.22341cs.CRcs.AIcs.CL
收藏

T-MAP: 通过轨迹感知的进化搜索实现红队攻击LLM代理

T-MAP: Red-Teaming LLM Agents with Trajectory-aware Evolutionary Search

KAIST(韩国科学技术院);University of California, Los Angeles(加州大学洛杉矶分校)

Hyomin Lee, Sangwoo Park, Yumin Choi, Sohyun An, Seanie Lee, Sung Ju Hwang

AI总结:

本文提出T-MAP方法,通过轨迹感知的进化搜索发现对抗性提示,有效突破安全防护并实现有害目标,实验显示其在攻击实现率上优于基线方法,适用于多步骤工具执行的LLM代理安全测试。

摘要:

尽管先前的红队努力主要针对大型语言模型(LLM)的有害文本输出,但此类方法未能捕捉到通过多步骤工具执行产生的代理特定漏洞,特别是在快速增长的生态系统如模型上下文协议(MCP)中。为解决这一差距,我们提出了一种轨迹感知的进化搜索方法T-MAP,利用执行轨迹指导对抗性提示的发现。我们的方法能够自动生成攻击,不仅绕过安全防护,还能通过实际工具交互可靠地实现有害目标。在多样化的MCP环境中进行的实证评估表明,T-MAP在攻击实现率(ARR)上显著优于基线方法,并且在前沿模型如GPT-5.2、Gemini-3-Pro、Qwen3.5和GLM-5上仍有效,从而揭示了自主LLM代理中此前未被探索的漏洞。

英文摘要:

While prior red-teaming efforts have focused on eliciting harmful text outputs from large language models (LLMs), such approaches fail to capture agent-specific vulnerabilities that emerge through multi-step tool execution, particularly in rapidly growing ecosystems such as the Model Context Protocol (MCP). To address this gap, we propose a trajectory-aware evolutionary search method, T-MAP, which leverages execution trajectories to guide the discovery of adversarial prompts. Our approach enables the automatic generation of attacks that not only bypass safety guardrails but also reliably realize harmful objectives through actual tool interactions. Empirical evaluations across diverse MCP environments demonstrate that T-MAP substantially outperforms baselines in attack realization rate (ARR) and remains effective against frontier models, including GPT-5.2, Gemini-3-Pro, Qwen3.5, and GLM-5, thereby revealing previously underexplored vulnerabilities in autonomous LLM agents. Code is available at https://github.com/pwnhyo/T-MAP.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑