arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.09270cs.AI
收藏

迈向更安全的生成式语言模型:安全风险、评估与改进综述

Towards Safer Generative Language Models: A Survey on Safety Risks, Evaluations, and Improvements

University of Electronic Science and Technology of China(电子科技大学);Tsinghua University(清华大学)

Jiawen Deng, Jiale Cheng, Hao Sun, Zhexin Zhang, Minlie Huang

AI总结:

本文系统综述了生成式大模型的安全风险、评估方法与改进策略,覆盖从训练到部署的全流程,并指出可解释性、持续安全问题和对抗鲁棒性等核心挑战,为安全研究提供技术指导。

摘要:

随着生成式大模型能力的不断进步,其输出中的安全问题日益凸显。为了确保人工智能生态系统的可持续发展,必须对相关安全风险进行全面评估与改进。本综述提出了一个面向大模型安全研究的框架,描绘了安全风险的图景以及安全评估与改进方法。我们首先介绍广泛关注的安全问题,然后深入探讨大模型的安全评估方法,包括基于偏好的测试、对抗攻击方法、问题检测以及其他先进评估方法。此外,我们探索了从训练到部署过程中增强大模型安全性的策略,重点介绍了构建大模型各阶段的前沿安全方法。最后,我们讨论了迈向更负责任的人工智能所面临的核心挑战,包括安全机制的可解释性、持续存在的安全问题以及对恶意攻击的鲁棒性。通过本综述,我们旨在为安全研究人员提供清晰的技术指导,并鼓励对大模型安全性的进一步研究。

英文摘要:

As generative large model capabilities advance, safety concerns become more pronounced in their outputs. To ensure the sustainable growth of the AI ecosystem, it's imperative to undertake a holistic evaluation and refinement of associated safety risks. This survey presents a framework for safety research pertaining to large models, delineating the landscape of safety risks as well as safety evaluation and improvement methods. We begin by introducing safety issues of wide concern, then delve into safety evaluation methods for large models, encompassing preference-based testing, adversarial attack approaches, issues detection, and other advanced evaluation methods. Additionally, we explore the strategies for enhancing large model safety from training to deployment, highlighting cutting-edge safety approaches for each stage in building large models. Finally, we discuss the core challenges in advancing towards more responsible AI, including the interpretability of safety mechanisms, ongoing safety issues, and robustness against malicious attacks. Through this survey, we aim to provide clear technical guidance for safety researchers and encourage further study on the safety of large models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑