arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.08689cs.CRcs.AI
收藏

AI 智能体的安全性

Security of AI Agents

University of California, Davis(加利福尼亚大学戴维斯分校)

Yifeng He, Ethan Wang, Yuyang Rong, Zifei Cheng, Hao Chen

AI总结:

本文从系统安全视角详细分析了大型语言模型驱动的 AI 智能体存在的潜在安全漏洞及其成因与影响,并针对每种漏洞提出相应的防御机制,通过实验评估其可行性,以提升 AI 智能体的安全性与可靠性。

摘要:

AI 智能体受大型语言模型推动。AI 智能体可作为智能助手,凭借访问工具及在环境中执行命令的能力,代表用户完成任务。通过研究典型 AI 智能体的工作流,我们提出了若干关于其安全性的担忧。这些潜在漏洞既未被构建智能体的框架所解决,也未被旨在改进智能体的研究所处理。本文从系统安全视角详细识别并描述了这些漏洞,强调其成因与严重影响。此外,我们针对每种漏洞引入了相应的防御机制,并通过设计与实验评估其可行性。总体而言,本文将当前 AI 智能体发展中的安全问题置于语境中,并阐明使 AI 智能体更安全、更可靠的方法。

英文摘要:

AI agents have been boosted by large language models. AI agents can function as intelligent assistants and complete tasks on behalf of their users with access to tools and the ability to execute commands in their environments. Through studying and experiencing the workflow of typical AI agents, we have raised several concerns regarding their security. These potential vulnerabilities are not addressed by the frameworks used to build the agents, nor by research aimed at improving the agents. In this paper, we identify and describe these vulnerabilities in detail from a system security perspective, emphasizing their causes and severe effects. Furthermore, we introduce defense mechanisms corresponding to each vulnerability with design and experiments to evaluate their viability. Altogether, this paper contextualizes the security issues in the current development of AI agents and delineates methods to make AI agents safer and more reliable.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑