arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.14719cs.CRcs.CVcs.LG
收藏

利用颜色感知替换绕过LLM水印

Bypassing LLM Watermarks with Color-Aware Substitutions

University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Qilong Wu, Varun Chandrasekaran

AI总结:

针对LLM水印鲁棒性评估的开放问题,提出首个“颜色感知”攻击方法SCTS,通过策略性提示获取颜色信息并用非绿色词元替换绿色词元,以更少编辑次数成功规避检测,并理论上和实验上证明其能移除任意长文本的水印。

摘要:

提出水印方法以识别流通文本是人类还是大型语言模型(LLM)生成的。Kirchenbauer等人(2023a)的最先进水印策略使LLM偏向于生成特定(“绿色”)词元。然而,确定此水印方法的鲁棒性是一个开放问题。现有攻击方法无法对较长文本段规避检测。我们克服了这一限制,提出了首个“颜色感知”攻击——自颜色测试替换(SCTS)。SCTS通过策略性地提示带水印的LLM并比较输出词元频率来获取颜色信息。它利用该信息确定词元颜色,并用非绿色词元替换绿色词元。实验中,SCTS以比相关工作更少的编辑次数成功规避了水印检测。此外,我们在理论和经验上均证明,SCTS能移除任意长度带水印文本的水印。

英文摘要:

Watermarking approaches are proposed to identify if text being circulated is human or large language model (LLM) generated. The state-of-the-art watermarking strategy of Kirchenbauer et al. (2023a) biases the LLM to generate specific (``green'') tokens. However, determining the robustness of this watermarking method is an open problem. Existing attack methods fail to evade detection for longer text segments. We overcome this limitation, and propose {\em Self Color Testing-based Substitution (SCTS)}, the first ``color-aware'' attack. SCTS obtains color information by strategically prompting the watermarked LLM and comparing output tokens frequencies. It uses this information to determine token colors, and substitutes green tokens with non-green ones. In our experiments, SCTS successfully evades watermark detection using fewer number of edits than related work. Additionally, we show both theoretically and empirically that SCTS can remove the watermark for arbitrarily long watermarked text.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑