arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.07557cs.SE
收藏

AgentRaft: LLM代理中数据过度暴露的自动检测

AgentRaft: Automated Detection of Data Over-Exposure in LLM Agents

Sun Yat-sen University(中山大学);University of Central Florida(中佛罗里达大学)

Yixi Lin, Jiangrong Wu, Yuhong Nan, Xueqiang Wang, Xinyuan Zhang, Zibin Zheng

AI总结:

AgentRaft通过程序分析与语义推理,自动检测LLM代理中的数据过度暴露风险,提升隐私保护效果。

摘要:

大型语言模型(LLM)代理在自主任务执行中的快速整合已引发了跨工具数据流中的重大隐私问题。在本文中,我们系统地研究并定义了LLM代理中的一种新风险,称为数据过度暴露(DOE),即代理无意中传输了超出用户意图和功能必要范围的敏感数据。我们发现,DOE主要由工具设计中的广泛数据范式和LLM中固有的粗粒度数据处理驱动。在本文中,我们提出了AgentRaft,这是首个用于检测LLM代理中DOE风险的自动化框架。AgentRaft通过三个协同模块结合程序分析与语义推理:(1)它构建了跨工具功能调用图(FCG)以建模异构工具的交互景观;(2)它遍历FCG以合成高质量的测试用户提示,这些提示作为深度层工具执行的确定性触发器;(3)它执行运行时污点跟踪,并采用基于全球隐私法规(如GDPR、CCPA、PIPL)的多LLM投票委员会以准确识别隐私违规。我们在包含6,675个真实世界代理工具的测试环境中评估了AgentRaft。我们的发现表明,DOE确实是一种系统性风险,在潜在工具交互路径中普遍存在,占57.07%。AgentRaft实现了高检测准确性和有效性,比基线高出87.24%。此外,AgentRaft在仅150个提示内达到近100%的DOE覆盖,同时将每链验证成本降低了88.6%。我们的工作为构建可审计和符合隐私法规的LLM代理系统提供了实用基础。

英文摘要:

The rapid integration of Large Language Model (LLM) agents into autonomous task execution has introduced significant privacy concerns within cross-tool data flows. In this paper, we systematically investigate and define a novel risk termed Data Over-Exposure (DOE) in LLM Agent, where an Agent inadvertently transmits sensitive data beyond the scope of user intent and functional necessity. We identify that DOE is primarily driven by the broad data paradigms in tool design and the coarse-grained data processing inherent in LLMs. In this paper, we present AgentRaft, the first automated framework for detecting DOE risks in LLM agents. AgentRaft combines program analysis with semantic reasoning through three synergistic modules: (1) it constructs a Cross-Tool Function Call Graph (FCG) to model the interaction landscape of heterogeneous tools; (2) it traverses the FCG to synthesize high-quality testing user prompts that act as deterministic triggers for deep-layer tool execution; and (3) it performs runtime taint tracking and employs a multi-LLM voting committee grounded in global privacy regulations (e.g., GDPR, CCPA, PIPL) to accurately identify privacy violations. We evaluate AgentRaft on a testing environment of 6,675 real-world agent tools. Our findings reveal that DOE is indeed a systemic risk, prevalent in 57.07% of potential tool interaction paths. AgentRaft achieves a high detection accuracy and effectiveness, outperforming baselines by 87.24%. Furthermore, AgentRaft reaches near-total DOE coverage (99%) within only 150 prompts while reducing per-chain verification costs by 88.6%. Our work provides a practical foundation for building auditable and privacy-compliant LLM agent systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑