arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.01752cs.CLcs.CR

多比特LLM水印的WorldCup采样

WorldCup Sampling for Multi-bit LLM Watermarking

Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络与信息安全学院)

Yidan Wang, Yubing Ren, Yanan Cao, Li Guo

AI总结:

本文提出WorldCup框架,通过结构化通信通道建模和分层竞争机制实现多比特水印嵌入,提升文本质量和解码鲁棒性,实验表明其在容量、检测性、鲁棒性等方面优于现有方法。

摘要:

随着大语言模型(LLM)生成越来越像人类的文本,水印技术已成为可靠归属认证的有前景解决方案。虽然多比特水印能实现更丰富的溯源编码,但现有方法通常通过引入静态logit扰动和计数解码策略扩展零比特水印方案,这会导致文本质量下降和解码鲁棒性降低。本文提出WorldCup,一种多比特LLM水印框架,将采样过程建模为结构化通信通道,并通过互补信号引导的分层竞争机制嵌入信息位。此外,WorldCup通过熵感知调制保持生成质量,并通过置信度感知解码实现鲁棒的信息恢复。全面实验表明,WorldCup在信息容量、检测性、鲁棒性、文本质量和解码效率之间实现了良好平衡,持续优于现有基线方法。我们相信,这项工作为未来多比特LLM水印研究奠定了可扩展和原则性的基础。

英文摘要:

As large language models (LLMs) generate increasingly human-like text, watermarking has emerged as a promising solution for reliable attribution beyond mere detection. While multi-bit watermarking enables richer provenance encoding, existing approaches typically extend zero-bit watermarking schemes by introducing static logit perturbations and counting-based decoding strategies, which can degrade text quality and compromise decoding robustness as the payload increases. In this paper, we propose WorldCup, a multi-bit watermarking framework for LLMs that models the sampling process as a structured communication channel and embeds message bits through a hierarchical competition mechanism guided by complementary signals. Moreover, WorldCup incorporates entropy-aware modulation to preserve generation quality and enables robust message recovery via confidence-aware decoding that accounts for token-level reliability. Comprehensive experiments demonstrate that WorldCup achieves a strong balance across message capacity, detectability, robustness, text quality, and decoding efficiency, consistently outperforming prior baselines. We believe that this work establishes a scalable and principled foundation for future research on multi-bit watermarking in LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑