arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.04534cs.CLcs.AI

BanglaLorica: 大型语言模型在孟加拉语文本生成中的鲁棒水印算法设计与评估

BanglaLorica: Design and Evaluation of a Robust Watermarking Algorithm for Large Language Models in Bangla Text Generation

Systems and Software Lab (SSL) Department of Computer Science and Engineering(系统与软件实验室(SSL)计算机科学与工程系)

Amit Bin Tariqul, A N M Zahid Hossain Milkan, Sahab-Al-Chowdhury, Syed Rifat Raiyan, Hasan Mahmud, Md Kamrul Hasan

AI总结:

本文提出分层水印策略,提升孟加拉语LLM在RTT攻击下的检测精度,实现3-4倍的相对提升。

摘要:

随着大型语言模型(LLMs)越来越多地用于文本生成,水印技术已成为版权归属、知识产权保护和滥用检测的关键。尽管现有水印方法在高资源语言中表现良好,但其在低资源语言中的鲁棒性仍缺乏深入研究。本文首次系统评估了最先进的文本水印方法:KGW、指数采样(EXP)和瀑布法,针对孟加拉语LLM文本生成在跨语言往返翻译(RTT)攻击下的性能。在良性条件下,KGW和EXP在检测精度(>88%)方面表现优异,同时 perplexity 和 ROUGE 降级极小。然而,RTT导致检测精度急剧下降至9-13%,表明基于令牌的水印方法存在根本性失败。为解决此问题,我们提出了一种分层水印策略,结合嵌入时和生成后水印。实验结果表明,分层水印使RTT后检测精度提高25-35%,达到40-50%的精度,相较于单层方法,相对提升3至4倍,代价是可控的语义降级。我们的发现量化了多语言水印中的鲁棒性-质量权衡,并确立了分层水印作为低资源语言(如孟加拉语)的实用、无需训练的解决方案。我们的代码和数据将公开。

英文摘要:

As large language models (LLMs) are increasingly deployed for text generation, watermarking has become essential for authorship attribution, intellectual property protection, and misuse detection. While existing watermarking methods perform well in high-resource languages, their robustness in low-resource languages remains underexplored. This work presents the first systematic evaluation of state-of-the-art text watermarking methods: KGW, Exponential Sampling (EXP), and Waterfall, for Bangla LLM text generation under cross-lingual round-trip translation (RTT) attacks. Under benign conditions, KGW and EXP achieve high detection accuracy (>88%) with negligible perplexity and ROUGE degradation. However, RTT causes detection accuracy to collapse below RTT causes detection accuracy to collapse to 9-13%, indicating a fundamental failure of token-level watermarking. To address this, we propose a layered watermarking strategy that combines embedding-time and post-generation watermarks. Experimental results show that layered watermarking improves post-RTT detection accuracy by 25-35%, achieving 40-50% accuracy, representing a 3$\times$ to 4$\times$ relative improvement over single-layer methods, at the cost of controlled semantic degradation. Our findings quantify the robustness-quality trade-off in multilingual watermarking and establish layered watermarking as a practical, training-free solution for low-resource languages such as Bangla. Our code and data will be made public.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑