多智能体系统的风险与管控：跨组织边界部署AI智能体的分析框架
Risks and Controls for Multi-Agent Systems: an analytical framework for deployment of AI agents across organisational boundaries
浏览论文内容
中文总结 AI 辅助
本研究提出跨组织边界部署AI智能体的分析框架，定义三类部署层级并分析各层级的风险、管控缺口与所需集体行动，为相关方应对多智能体交互风险提供支撑。
中文摘要 AI 辅助
本报告提出了一个框架，帮助组织、政策制定者和研究人员分析AI智能体相互交互时产生的风险、这些风险如何因交互跨越组织边界而变化，以及可用于应对这些风险的管控措施。随着组织部署AI智能体，这些智能体将越来越多地相互交互：在组织内部、与合作伙伴、客户和供应商的智能体交互，以及与公开互联网上的未知交易对手交互。故障可能源于交互本身，且一旦这些交互跨越组织边界，没有任何单个组织能够完全查看、控制或管理它们。本报告引入了三个部署层级，由约束任意两个交互智能体的最低共同治理机制定义：单一治理，即一个组织管理所有智能体；联邦治理，即多个组织在商定规则下将智能体部署到共享环境中；开放环境，即智能体在没有中央权威的情况下运行，共享标准仅在自愿的情况下被采用。在每个层级内，本报告研究风险因素、故障模式和可用管控措施，确定谁有能力应用这些管控措施，并在没有任何行为者具备行动能力的情况下，描述管控缺口以及弥合该缺口所需的集体行动。
英文摘要
This report presents a framework to help organisations, policymakers and researchers reason about the risks that emerge when AI agents interact with each other, how those risks change as interactions cross organisational boundaries, and the controls that may help address them. As organisations deploy AI agents, those agents will increasingly interact with each other: inside the organisation, with the agents of partners, customers and suppliers, and with unknown counterparties on the open internet. Failures can emerge from the interactions themselves, and once those interactions cross an organisation's perimeter, no single organisation can fully see, control or govern them. The report introduces three deployment tiers, defined by the minimum common governance binding any two interacting agents: singular governance, where one organisation governs every agent; federated governance, where multiple organisations deploy into a shared environment under agreed rules; and open environments, where agents operate with no central authority and shared standards are adopted voluntarily if at all. Within each tier, the report examines risk factors, failure modes and available controls. It identifies who is positioned to apply the controls, and where no actor is positioned to act, it characterises the gap and the collective action required to close it.
发表机构
- Gradient Institute（梯度研究所）
- Department of Industry, Science and Resources（工业、科学与资源部）
机构由 AI 辅助整理，请以论文原文为准。
