arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.00517cs.CRcs.AI
收藏

基于多维度攻防的大模型生成安全性增强方法

A Method for Enhancing the Safety of Large Model Generation Based on Multi-dimensional Attack and Defense

Keke Zhai

AI总结:

本文提出基于多维度攻防对齐数据的方法,通过提升攻击指令多样性和安全响应准确性来增强大模型生成安全性,并在Llama3.2上验证其能显著提升防御能力且保持通用性能。

摘要:

当前,大模型在面对复杂攻击指令时容易生成有害内容,显著降低了其防御能力。为解决这一问题,本文提出一种基于构建多维度攻防对齐数据的方法,以增强大模型的生成安全性。该方法的核心在于通过创新性地提高攻击指令维度的多样性以及生成安全响应的准确性,来提升大模型安全对齐学习的有效性。为验证方法的有效性,在现有安全评估基准之外,我们额外设计了新的安全评估基准,并以Llama3.2作为基线模型进行了对比实验。最终实验结果表明,我们的方法能够显著提升大模型在复杂指令攻击下的生成安全性,同时保持并增强模型的通用能力。

英文摘要:

Currently, large models are prone to generating harmful content when faced with complex attack instructions, significantly reducing their defensive capabilities. To address this issue, this paper proposes a method based on constructing data aligned with multi-dimensional attack defense to enhance the generative security of large models. The core of our method lies in improving the effectiveness of safe alignment learning for large models by innova-tively increasing the diversity of attack instruction dimensions and the accuracy of generat-ing safe responses. To validate the effectiveness of our method, beyond existing security evaluation benchmarks, we additionally designed new security evaluation benchmarks and conducted comparative experiments using Llama3.2 as the baseline model. The final ex-perimental results demonstrate that our method can significantly improve the generative security of large models under complex instructional attacks, while also maintaining and enhancing the models' general capabilities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑