arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.09002cs.CRcs.AI
收藏

多智能体系统中的安全考虑

Security Considerations for Multi-agent Systems

Crew Scaler;North Carolina A&T State University(北卡罗来纳A&T州立大学);MITRE ATLAS;ATFAA-SHIELD;CDAO Generative AI Responsible AI Toolkit(CDAO生成式AI责任AI工具包)

Tam Nguyen, Moses Ndebugre, Dheeraj Arremsetty

AI总结:

本文系统分析了多智能体系统(MAS)的安全威胁,并评估了16个AI安全框架,发现非确定性和数据泄露是最薄弱环节,OWASP和CDAO在设计和开发阶段表现突出。

摘要:

多智能体人工智能系统或MAS是自主代理系统,通过委托工具权限、共享持久内存和通过代理间通信协调。MAS引入了与单个AI模型不同的安全漏洞。现有安全和治理框架未针对这些新兴攻击面进行设计。本文系统地描述了MAS的威胁景观,并定量评估了16个AI安全框架。提出四阶段方法:构建生产多智能体架构的深度技术知识库;利用生成式AI辅助进行针对MAS网络安全风险的威胁建模,并由领域专家验证;在个体威胁粒度上制定调查计划;并根据网络安全风险对每个框架进行评分。风险被组织成193个不同的主要威胁项,跨越九个风险类别。预期的最小平均得分为2。没有审查的框架在任何单一类别中实现多数覆盖。非确定性(在16个框架中平均得分为1.231)和数据泄露(1.340)是最未被解决的领域。OWASP Agentic Security Initiative在整体覆盖率达到65.3%并在设计阶段领先;CDAO Generative AI Responsible AI Toolkit在开发和运营覆盖方面领先。这些结果提供了多智能体系统安全的首次实证跨框架比较,并为框架选择提供了基于证据的指导。请查看已发表期刊版本的信息。

英文摘要:

Multi-agent artificial intelligence systems or MAS are systems of autonomous agents that exercise delegated tool authority, share persistent memory, and coordinate via inter-agent communication. MAS introduces qualitatively distinct security vulnerabilities from those documented for singular AI models. Existing security and governance frameworks were not designed for these emerging attack surfaces. This study systematically characterizes the threat landscape of MAS and quantitatively evaluates 16 security frameworks for AI against it. A four-phase methodology is proposed: constructing a deep technical knowledge base of production multi-agent architectures; conducting generative AI-assisted threat modeling scoped to MAS cybersecurity risks and validated by domain experts; structuring survey plans at individual-threat granularity; and scoring each framework on a three-point scale against the cybersecurity risks. The risks were organized into 193 distinct main threat items across nine risk categories. The expected minimal average score is 2. No reviewed framework achieves majority coverage of any single category. Non-Determinism (mean score 1.231 across all 16 frameworks) and Data Leakage (1.340) are the most under-addressed domains. The OWASP Agentic Security Initiative leads overall at 65.3\% coverage and in the design phase; the CDAO Generative AI Responsible AI Toolkit leads in development and operational coverage. These results provide the first empirical cross-framework comparison for MAS security and offer evidence-based guidance for framework selection. Please check back for information on the published journal version.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑