arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.01038cs.CRcs.AI
收藏

AutoAttacker:一个由大语言模型引导的自动网络攻击实施系统

AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacks

University of California, Irvine(加利福尼亚大学欧文分校);Microsoft(微软公司)

Jiacen Xu, Jack W. Stokes, Geoff McDonald, Xuesong Bai, David Marshall, Siyue Wang, Adith Swaminathan, Zhou Li

AI总结:

本文提出AutoAttacker,探索由LLM引导自动实施入侵后“hands-on-keyboard”攻击,以评估安全风险并支持防御评估、红队扩展与新型攻击检测。

摘要:

大语言模型(LLM)已在自然语言任务上展现出令人瞩目的成果,安全研究人员也开始将其用于攻击型与防御型系统。在网络安全领域,已有多项研究利用LLM聚焦于攻击的入侵前阶段,例如钓鱼和恶意软件生成。然而,迄今为止,尚缺乏一项全面研究,探讨基于LLM的系统能否在各种攻击技术和环境下,模拟通常由人工操作的入侵后攻击阶段,即“hands-on-keyboard”(手在键盘上)攻击。随着LLM不可避免地持续进步,它们或许能够将入侵前和入侵后攻击阶段都自动化。这一转变可能使组织级攻击从罕见的、由专家主导的事件,变为频繁的自动化操作:无需专业知识,并以自动化速度和规模执行。这有可能从根本上改变全球计算机安全,并相应造成重大经济影响;本工作的目标之一是现在就更好地理解这些风险,以便我们为即将出现的、不可避免且能力越来越强的LLM做好更充分准备。在直接影响方面,本研究有三个目的。第一,自动化的、基于LLM的入侵后利用框架可以帮助分析师快速测试并持续改进其组织针对前所未见攻击的网络安全态势。第二,基于LLM的渗透测试系统可以在人类分析师数量有限的情况下扩展红队的效能。最后,本研究可以帮助防御系统和团队学会在新型攻击行为被野外利用之前,先发制人地检测这些行为。

英文摘要:

Large language models (LLMs) have demonstrated impressive results on natural language tasks, and security researchers are beginning to employ them in both offensive and defensive systems. In cyber-security, there have been multiple research efforts that utilize LLMs focusing on the pre-breach stage of attacks like phishing and malware generation. However, so far there lacks a comprehensive study regarding whether LLM-based systems can be leveraged to simulate the post-breach stage of attacks that are typically human-operated, or "hands-on-keyboard" attacks, under various attack techniques and environments. As LLMs inevitably advance, they may be able to automate both the pre- and post-breach attack stages. This shift may transform organizational attacks from rare, expert-led events to frequent, automated operations requiring no expertise and executed at automation speed and scale. This risks fundamentally changing global computer security and correspondingly causing substantial economic impacts, and a goal of this work is to better understand these risks now so we can better prepare for these inevitable ever-more-capable LLMs on the horizon. On the immediate impact side, this research serves three purposes. First, an automated LLM-based, post-breach exploitation framework can help analysts quickly test and continually improve their organization's network security posture against previously unseen attacks. Second, an LLM-based penetration test system can extend the effectiveness of red teams with a limited number of human analysts. Finally, this research can help defensive systems and teams learn to detect novel attack behaviors preemptively before their use in the wild....

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑