SFCoT:通过主动安全评估和校准实现更安全的推理链
SFCoT: Safer Chain-of-Thought via Active Safety Evaluation and Calibration
AI总结:
本文提出SFCoT框架,通过实时评估和校准潜在不安全的推理步骤,有效降低对抗攻击成功率,提升大语言模型的安全性。
摘要:
大型语言模型(LLMs)在复杂推理任务中表现出色,但易受劫持攻击影响安全对齐。现有防御机制通常仅对最终输出进行事后过滤,导致中间推理步骤未被监控且易受对抗操纵。为此,本文提出SaFer Chain-of-Thought(SFCoT)框架,通过实时评估和校准潜在不安全的推理步骤。SFCoT结合三级安全评分系统和多视角一致性验证机制,旨在检测推理过程中的潜在风险。动态干预模块随后执行针对性校准,将推理轨迹引导至安全结果。实验结果表明,SFCoT将攻击成功率从58.97%降至12.31%,证明其作为提升LLM安全性的有效且高效方法,且对通用性能影响不大。
英文摘要:
Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks. However, they remain highly susceptible to jailbreak attacks that undermine their safety alignment. Existing defense mechanisms typically rely on post hoc filtering applied only to the final output, leaving intermediate reasoning steps unmonitored and vulnerable to adversarial manipulation. To address this gap, this paper proposes a SaFer Chain-of-Thought (SFCoT) framework, which proactively evaluates and calibrates potentially unsafe reasoning steps in real time. SFCoT incorporates a three-tier safety scoring system alongside a multi-perspective consistency verification mechanism, designed to detect potential risks throughout the reasoning process. A dynamic intervention module subsequently performs targeted calibration to redirect reasoning trajectories toward safe outcomes. Experimental results demonstrate that SFCoT reduces the attack success rate from $58.97\%$ to $12.31\%$, demonstrating it as an effective and efficient LLM safety enhancement method without a significant decline in general performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。