arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.16586cs.AI
收藏

AI代理的运行时治理:路径上的政策

Runtime Governance for AI Agents: Policies on Paths

Eindhoven University of Technology(埃因霍温理工大学);Kyvvu B.V.(Kyvvu公司)

Maurits Kaptein, Vassilis-Javed Khan, Andriy Podstavnychy

AI总结:

本文提出通过路径作为核心对象,研究AI代理运行时治理,探讨路径依赖政策的框架与实现,分析合规性评估及开放问题。

摘要:

AI代理--利用大语言模型进行计划、推理和行动的系统--产生非确定性、路径依赖的行为,无法在设计时完全治理。我们主张执行路径是有效运行时治理的核心对象,并将合规政策形式化为确定性函数,将代理身份、部分路径、提议下一步行动和组织状态映射到政策违规概率。我们展示提示级别指令(和系统提示)和静态访问控制是此框架的特殊案例:前者在不实际评估路径的情况下塑造路径分布;后者评估确定性政策,忽略路径(即只能考虑所有可能路径的一部分)。我们认为运行时评估是通用情况,对任何路径依赖政策都是必要的。我们开发了分析AI代理治理的正式框架,提出了具体的政策示例(受AI法案启发),讨论了参考实现,并识别了开放问题,包括风险校准和强制合规的限制。

英文摘要:

AI agents -- systems that plan, reason, and act using large language models -- produce non-deterministic, path-dependent behavior that cannot be fully governed at design time, where with governed we mean striking the right balance between as high as possible successful task completion rate and the legal, data-breach, reputational and other costs associated with running agents. We argue that the execution path is the central object for effective runtime governance and formalize compliance policies as deterministic functions mapping agent identity, partial path, proposed next action, and organizational state to a policy violation probability. We show that prompt-level instructions (and "system prompts"), and static access control are special cases of this framework: the former shape the distribution over paths without actually evaluating them; the latter evaluates deterministic policies that ignore the path (i.e., these can only account for a specific subset of all possible paths). In our view, runtime evaluation is the general case, and it is necessary for any path-dependent policy. We develop the formal framework for analyzing AI agent governance, present concrete policy examples (inspired by the AI act), discuss a reference implementation, and identify open problems including risk calibration and the limits of enforced compliance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑