arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.17837cs.CRcs.CLcs.LG
收藏

TFL:针对大语言模型的定向位翻转攻击

TFL: Targeted Bit-Flip Attack on Large Language Model

School of Electrical, Computer and Energy Engineering(电气、计算机与能源工程学院);Arizona State University(亚利桑那州立大学)

Jingkai Guo, Chaitali Chakrabarti, Deliang Fan

AI总结:

TFL是一种新型定向位翻转攻击框架,通过精确操控LLM输出并减少对无关输入的影响,提升攻击的隐蔽性和针对性。

摘要:

大语言模型(LLMs)正在越来越多地应用于安全和安全关键应用,这引发了对其对模型参数故障注入攻击鲁棒性的担忧。最近的研究表明,位翻转攻击(BFAs)通过利用计算机主内存(即DRAM)的漏洞,翻转模型权重中的少量位,可以严重破坏LLM的行为。然而,现有的LLM位翻转攻击大多导致非目标失败或整体性能下降,对特定或目标输出的控制有限。在本文中,我们提出了TFL,一种新颖的定向位翻转攻击框架,该框架能够在选定的提示上精确操控LLM的输出,同时对无关输入几乎不产生或仅有轻微的降级影响。在我们的TFL框架中,我们提出了一种新的关键词聚焦攻击损失,以促进生成输出中攻击者指定的目标令牌,同时辅以一个辅助效用分数,以平衡攻击效果与对良性数据的副作用影响。我们评估了TFL在多个LLM(Qwen、DeepSeek、Llama)和基准(DROP、GSM8K和TriviaQA)上的表现。实验表明,TFL在少于50次位翻转的情况下实现了成功的定向LLM输出操控,并且对无关查询的影响显著低于先前的BFA方法。这证明了TFL的有效性,并将其定位为一种新的隐秘且定向的LLM模型攻击类别。

英文摘要:

Large language models (LLMs) are increasingly deployed in safety and security critical applications, raising concerns about their robustness to model parameter fault injection attacks. Recent studies have shown that bit-flip attacks (BFAs), which exploit computer main memory (i.e., DRAM) vulnerabilities to flip a small number of bits in model weights, can severely disrupt LLM behavior. However, existing BFA on LLM largely induce un-targeted failure or general performance degradation, offering limited control over manipulating specific or targeted outputs. In this paper, we present TFL, a novel targeted bit-flip attack framework that enables precise manipulation of LLM outputs for selected prompts while maintaining almost no or minor degradation on unrelated inputs. Within our TFL framework, we propose a novel keyword-focused attack loss to promote attacker-specified target tokens in generative outputs, together with an auxiliary utility score that balances attack effectiveness against collateral performance impact on benign data. We evaluate TFL on multiple LLMs (Qwen, DeepSeek, Llama) and benchmarks (DROP, GSM8K, and TriviaQA). The experiments show that TFL achieves successful targeted LLM output manipulations with less than 50 bit flips and significantly reduced effect on unrelated queries compared to prior BFA approaches. This demonstrates the effectiveness of TFL and positions it as a new class of stealthy and targeted LLM model attack.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑