arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.04902cs.CRcs.AI
收藏

AgentSCOPE: 在代理工作流中评估上下文隐私

AgentSCOPE: Evaluating Contextual Privacy Across Agentic Workflows

University of Vermont(佛蒙特大学);IBM Research(IBM研究院)

Ivoline C. Ngong, Keerthiram Murugesan, Swanand Kadhe, Justin D. Weisz, Amit Dhurandhar, Karthikeyan Natesan Ramamurthy

AI总结:

AgentSCOPE通过评估代理工作流中的隐私流,揭示了中间阶段的隐私风险,指出输出层面评估不足以反映代理系统的隐私问题。

摘要:

代理系统正在越来越多地代表用户行事,访问日历、电子邮件和个人文件以完成日常任务。隐私评估这些系统一直集中在输入和输出边界,但每个任务涉及多个中间信息流,从代理查询到工具响应,这些目前未被评估。我们主张代理管道中的每个边界都是潜在隐私侵犯的地点,必须独立评估。为此,我们引入了隐私流图,一个基于上下文完整性的框架,将代理执行分解为一系列信息流,每个信息流都标注有五个CI参数,并追踪违规行为到其起源点。我们提出了AgentSCOPE,一个包含八个监管领域中62个多工具场景的基准测试集,在每个管道阶段都有真实数据。我们的评估显示,跨七种最先进的LLM,在超过80%的场景中管道中存在隐私违规行为,即使最终输出看起来干净(24%),大多数违规行为发生在工具响应阶段,API随意返回敏感数据。这些结果表明,仅评估输出级别显著低估了代理系统的隐私风险。

英文摘要:

Agentic systems are increasingly acting on users' behalf, accessing calendars, email, and personal files to complete everyday tasks. Privacy evaluation for these systems has focused on the input and output boundaries, but each task involves several intermediate information flows, from agent queries to tool responses, that are not currently evaluated. We argue that every boundary in an agentic pipeline is a site of potential privacy violation and must be assessed independently. To support this, we introduce the Privacy Flow Graph, a Contextual Integrity-grounded framework that decomposes agentic execution into a sequence of information flows, each annotated with the five CI parameters, and traces violations to their point of origin. We present AgentSCOPE, a benchmark of 62 multi-tool scenarios across eight regulatory domains with ground truth at every pipeline stage. Our evaluation across seven state-of-the-art LLMs show that privacy violations in the pipeline occur in over 80% of scenarios, even when final outputs appear clean (24%), with most violations arising at the tool-response stage where APIs return sensitive data indiscriminately. These results indicate that output-level evaluation alone substantially underestimates the privacy risk of agentic systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑