arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.03344cs.CRcs.LG
收藏

RogueMerge: 针对大语言模型合并的鲁棒统一攻击

RogueMerge: Robust and Unified Attacks against LLM Model Merging

University of California, Los Angeles(加州大学洛杉矶分校)

Jinghuai Zhang, Yetian He, Kunlin Cai, Han Zhao, Fnu Suya, Yuan Tian

AI总结:

提出RogueMerge框架,通过联合优化、元学习模拟和分布鲁棒优化,解决模型合并中针对自回归生成、未知合并配置和攻击提示泛化的三大挑战,实现鲁棒且统一的攻击。

摘要:

模型合并通过聚合来自未验证公共平台的任务向量,将专门能力组合到单个大语言模型中,暴露了关键的供应链攻击面:由于任何恶意行为都可以编码到任务向量中,并且合并允许第三方向量直接写入模型权重,攻击者提供的任务向量可以启用或放大多种下游威胁。先前的工作仅研究针对分类器的模型合并的后门攻击,使用静态算术启发式方法,由于三个原因无法有效处理针对生成式大语言模型的各种攻击。(i) 大语言模型依赖于自回归解码,合并引入的微小参数漂移会在令牌间累积并迅速降低攻击效果。(ii) 攻击者不知道受害者的合并配置,导致独立优化的静态攻击向量容易被稀释或破坏。(iii) 实际威胁诱导必须泛化到优化期间未见过的攻击提示,静态向量无法充分编码。我们提出RogueMerge,这是第一个原则性的统一框架,解决了所有三个挑战。为了处理自回归生成,我们用联合优化替代静态算术,明确强制合并后的攻击成功。为了处理未知的合并设置,我们将攻击注入表述为随机最小-最大问题,并通过元学习风格的模拟来解决。为了在异构攻击提示间泛化,我们采用分布鲁棒优化,并在大语言模型规模下推导出可处理的一阶泰勒近似,具有可证明的误差界。在四种威胁、六种合并算法和超过170个合并的大语言模型上,RogueMerge始终优于现有攻击。它还在多种合并设置下保持稳定,并能抵抗标准防御。

英文摘要:

Model merging composes specialized capabilities into a single LLM by aggregating task-specific LLMs sourced from unverified public platforms, exposing a critical supply-chain attack surface: Because any malicious behavior can be encoded into a task vector, and merging grants third-party vectors direct write access to model weights, an attacker-provided task vector can enable or amplify diverse downstream threats. Prior work only examines backdoor attacks against model merging for classifiers using static arithmetic heuristics, which fail to effectively achieve diverse attacks on generative LLMs for three reasons: (i) LLMs rely on autoregressive decoding, where even a minor parameter drift introduced by merging compounds across tokens and rapidly degrades the attack. (ii) Attackers have no knowledge of the victim's merging configurations, causing a static attack vector optimized in isolation to be easily diluted or neutralized. (iii) Practical threat induction must generalize to attack prompts unseen during optimization, which static vectors cannot adequately encode. In light of these gaps, we present RogueMerge, the first unified attack framework addressing all three challenges. To handle autoregressive generation, we replace static arithmetic with a joint optimization that explicitly enforces attack success after merging. To better simulate unknown merging settings, we formulate attack injection as a stochastic min-max optimization problem and solve it via meta-gradient descent. To generalize across heterogeneous attack prompts, we employ distributionally robust optimization and derive a tractable first-order Taylor approximation at LLM scale, with a provable error bound. Across four threats, six merging algorithms, and over 170 merged LLMs, RogueMerge consistently outperforms prior attacks. It also remains stable across diverse merging settings and resists standard defenses.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑