arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.02027cs.AIcs.LG
收藏

通过单个神经元的模型自反进行轻量级对齐以提升大语言模型的安全性

Light Alignment Improves LLM Safety via Model Self-Reflection with a Single Neuron

Beijing Institute of AI Safety and Governance(北京人工智能安全与治理研究院);Beijing Key Laboratory of Safe AI and Superalignment(北京安全人工智能与超对齐重点实验室);Ant Group Co., Ltd.(蚂蚁集团有限公司);BrainCog Lab., CASIA(CASIA脑认知实验室);Zhongguancun Academy(中关村学院)

Sicheng Shen, Mingyang Lv, Han Shen, Jialin Wu, Binghao Wang, Zhou Yang, Guobin Shen, Dongcheng Zhao, Feifei Zhao, Yi Zeng

AI总结:

通过单个神经元的模型自反实现轻量级对齐,提升大语言模型的安全性和实用性

摘要:

大语言模型(LLMs)的安全性日益成为其发展中的基本方面。现有LLMs的安全对齐主要通过训练后的方法实现,这些方法计算成本高且往往在不同模型之间泛化效果不佳。少量轻量级对齐方法要么严重依赖先前计算的安全注入,要么过度依赖模型自身能力,导致泛化能力有限且在生成过程中效率和可用性降低。在本工作中,我们提出了一种安全意识解码方法,仅需对专家模型进行低成本训练,并采用单个神经元作为门控机制。通过有效平衡模型固有能力与外部指导,我们的方法同时保持了实用性并增强了输出安全性。它在训练开销和模型规模泛化方面表现出明显优势,为大语言模型的安全和实用部署提供了新的轻量级对齐视角。代码:https://github.com/Beijing-AISI/NGSD

英文摘要:

The safety of large language models (LLMs) has increasingly emerged as a fundamental aspect of their development. Existing safety alignment for LLMs is predominantly achieved through post-training methods, which are computationally expensive and often fail to generalize well across different models. A small number of lightweight alignment approaches either rely heavily on prior-computed safety injections or depend excessively on the model's own capabilities, resulting in limited generalization and degraded efficiency and usability during generation. In this work, we propose a safety-aware decoding method that requires only low-cost training of an expert model and employs a single neuron as a gating mechanism. By effectively balancing the model's intrinsic capabilities with external guidance, our approach simultaneously preserves utility and enhances output safety. It demonstrates clear advantages in training overhead and generalization across model scales, offering a new perspective on lightweight alignment for the safe and practical deployment of large language models. Code: https://github.com/Beijing-AISI/NGSD.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑