arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2512.04044cs.LGcs.AIcs.CR
收藏

MarkTune: 改善开放权重语言模型水印中的质量-可检测性权衡

MarkTune: Improving the Quality-Detectability Trade-off in Model-Embedded LLM Watermarking

University of Pennsylvania(宾夕法尼亚大学);Carnegie Mellon University(卡内基梅隆大学);Columbia University(哥伦比亚大学)

Yizhou Zhao, Zhiwei Steven Wu, Adam Block

AI总结:

MarkTune通过理论框架提升开放权重语言模型中质量与可检测性的平衡,优于GaussMark并保持生成质量。

摘要:

水印技术旨在嵌入隐藏信号到生成文本中,以便在获得秘密密钥时能够可靠地检测。开放权重语言模型对这类水印方案构成了严峻挑战,因为当前主流方法依赖的推理时间干预一旦模型权重公开便无法执行。现有的开放权重模型水印技术,如最近提出的GaussMark,通常依赖于对模型权重的小幅修改,这可以产生可被持有秘密密钥的人检测到的信号,但要实现与推理时间水印相当的检测能力通常需要显著降低生成质量。我们引入了MarkTune,这是一种理论上有根据的、基于策略的微调框架,将GaussMark信号视为奖励,同时通过正则化防止文本质量的下降。我们推导出MarkTune作为GaussMark的改进,并展示了MarkTune在质量-可检测性权衡上始终优于GaussMark,通过在模型表示空间内引导更精细的、水印意识的权重更新,同时保持生成质量。实证研究表明,MarkTune将GaussMark的质量-可检测性前沿推近推理时间水印的水平,对改写和微调攻击具有鲁棒性,并表现出强大的泛化能力:在一项数据集上微调的模型在未见过的数据集上仍能保持显著的水印检测能力。这些结果共同确立了MarkTune作为在开放权重语言模型中嵌入稳健、高质量水印的一般策略。

英文摘要:

Language model watermarking schemes fall into two broad categories: inference-time methods, which modify the decoding process at generation time, and model-embedded methods, which encode a secret signal directly into the model weights. Inference-time watermarking methods incur additional inference overhead and are not applicable in the increasingly prevalent open-weight model settings. In contrast, model-embedded watermarks introduce no additional inference latency-generation uses the standard sampling pipeline-and are particularly well-suited to open-weight settings. However, existing model-embedded approaches such as GaussMark face a fundamental quality-detectability trade-off: achieving strong detection power typically requires weight perturbations that noticeably degrade generation quality. Our key insight is that regularizing toward a high-quality reference distribution decouples quality preservation from proximity to the base model, enabling a better quality-detectability trade-off. Building on this insight, we introduce MarkTune, a theoretically grounded on-policy fine-tuning framework that uses the GaussMark detection statistic as a reward while preserving generation quality through cross-entropy on high-quality human text or KL divergence to a stronger oracle model. Empirically, MarkTune substantially improves the quality-detectability frontier of GaussMark, approaching the detectability of strong inference-time schemes while preserving generation quality and downstream task performance. Marktune also remains robust under the evaluated text-editing and open-weight attacks and generalizes across datasets, retaining substantial detection power on corpora unseen during training. Code is available at https://github.com/zhyzmath/MarkTune-LLM-Watermarking.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑