arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.01723cs.CR
收藏

结构表示用于AI代理威胁检测中的跨攻击泛化

Structural Representations for Cross-Attack Generalization in AI Agent Threat Detection

Vignesh Iyer

AI总结:

本文提出结构标记化方法,通过编码执行流程模式提升AI代理威胁检测的跨攻击泛化能力,显著提高对未知攻击的识别性能。

摘要:

自主AI代理在执行多步骤工具序列时面临语义攻击,这些攻击表现为行为轨迹而非孤立提示。关键挑战是跨攻击泛化:检测器是否能识别已知攻击家族外的新型攻击类型?我们发现标准对话标记化——捕捉代理交互中的语言模式——在结构攻击如工具劫持(AUC 0.39)和数据外泄(AUC 0.46)上彻底失败,而在语言攻击如社会工程(AUC 0.78)上表现良好。我们引入结构标记化,编码执行流程模式(工具调用、参数、观察)而非对话内容。这种简单的表示变化显著提高了跨攻击泛化能力:工具劫持上AUC提升46点,数据外泄提升39点,未知攻击提升71点,同时在分布内性能也提升6点。对于需要语言特征的攻击,我们提出门控多视图融合,适配性结合两种表示,实现社会工程AUC 0.89,不牺牲结构攻击检测。我们的发现揭示AI代理安全本质上是结构问题:攻击语义存在于执行模式,而非表层语言。虽然我们的规则标记器作为基线,结构抽象原则即使在简单实现下也具有泛化能力。

英文摘要:

Autonomous AI agents executing multi-step tool sequences face semantic attacks that manifest in behavioral traces rather than isolated prompts. A critical challenge is cross-attack generalization: can detectors trained on known attack families recognize novel, unseen attack types? We discover that standard conversational tokenization -- capturing linguistic patterns from agent interactions -- fails catastrophically on structural attacks like tool hijacking (AUC 0.39) and data exfiltration (AUC 0.46), while succeeding on linguistic attacks like social engineering (AUC 0.78). We introduce structural tokenization, encoding execution-flow patterns (tool calls, arguments, observations) rather than conversational content. This simple representational change dramatically improves cross-attack generalization: +46 AUC points on tool hijacking, +39 points on data exfiltration, and +71 points on unknown attacks, while simultaneously improving in-distribution performance (+6 points). For attacks requiring linguistic features, we propose gated multi-view fusion that adaptively combines both representations, achieving AUC 0.89 on social engineering without sacrificing structural attack detection. Our findings reveal that AI agent security is fundamentally a structural problem: attack semantics reside in execution patterns, not surface language. While our rule-based tokenizer serves as a baseline, the structural abstraction principle generalizes even with simple implementation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑