arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.02003cs.CRcs.AI
收藏

大型语言模型(LLM)安全与隐私综述:好的、坏的和丑的

A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly

Drexel University(德雷塞尔大学)

Yifan Yao, Jinhao Duan, Kaidi Xu, Yuanfang Cai, Zhibo Sun, Yue Zhang

AI总结:

本文综述了LLMs在安全与隐私领域的双重影响,将其应用分为有益、攻击性及漏洞三类,发现LLMs能提升代码与数据安全但也可被用于攻击,并指出了模型提取与安全微调等需深入研究的方向。

摘要:

大型语言模型(LLMs),如ChatGPT和Bard,彻底改变了自然语言理解和生成。它们具备深度的语言理解能力、类人文本生成能力、上下文感知能力以及强大的问题解决能力,使其在各个领域(例如搜索引擎、客户支持、翻译)中具有不可估量的价值。与此同时,LLMs在安全社区也获得了关注,揭示了安全漏洞并展示了其在安全相关任务中的潜力。本文探讨了LLMs与安全和隐私的交叉点。具体而言,我们调查了LLMs如何对安全和隐私产生积极影响、与其使用相关的潜在风险和威胁,以及LLMs内部的固有漏洞。通过全面的文献回顾,本文将论文分为“好的”(有益的LLM应用)、“坏的”(攻击性应用)和“丑的”(LLMs的漏洞及其防御)。我们有一些有趣的发现。例如,事实证明,LLMs能够增强代码安全(代码漏洞检测)和数据隐私(数据机密性保护),其表现优于传统方法。然而,由于具备类人推理能力,它们也可被用于各种攻击(特别是用户级攻击)。我们确定了需要进一步研究努力的领域。例如,关于模型和参数提取攻击的研究有限且通常是理论性的,受到LLM参数规模和机密性的阻碍。安全指令微调作为近期的发展,需要更多的探索。我们希望我们的工作能够阐明LLMs在加强和危害网络安全方面的潜力。

英文摘要:

Large Language Models (LLMs), such as ChatGPT and Bard, have revolutionized natural language understanding and generation. They possess deep language comprehension, human-like text generation capabilities, contextual awareness, and robust problem-solving skills, making them invaluable in various domains (e.g., search engines, customer support, translation). In the meantime, LLMs have also gained traction in the security community, revealing security vulnerabilities and showcasing their potential in security-related tasks. This paper explores the intersection of LLMs with security and privacy. Specifically, we investigate how LLMs positively impact security and privacy, potential risks and threats associated with their use, and inherent vulnerabilities within LLMs. Through a comprehensive literature review, the paper categorizes the papers into "The Good" (beneficial LLM applications), "The Bad" (offensive applications), and "The Ugly" (vulnerabilities of LLMs and their defenses). We have some interesting findings. For example, LLMs have proven to enhance code security (code vulnerability detection) and data privacy (data confidentiality protection), outperforming traditional methods. However, they can also be harnessed for various attacks (particularly user-level attacks) due to their human-like reasoning abilities. We have identified areas that require further research efforts. For example, Research on model and parameter extraction attacks is limited and often theoretical, hindered by LLM parameter scale and confidentiality. Safe instruction tuning, a recent development, requires more exploration. We hope that our work can shed light on the LLMs' potential to both bolster and jeopardize cybersecurity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑