Language model (LM) watermarking techniques inject a statistical signal into LM-generated content by substituting the random sampling process with pseudo-random sampling, using watermark keys as the random seed. Among these statistical watermarking approaches, distortion-free watermarks are particularly crucial because they embed watermarks into LM-generated content without compromising generation quality. However, one notable limitation of pseudo-random sampling compared to true-random sampling is that, under the same watermark keys (i.e., key collision), the results of pseudo-random sampling exhibit correlations. This limitation could potentially undermine the distortion-free property. Our studies reveal that key collisions are inevitable due to the limited availability of watermark keys, and existing distortion-free watermarks exhibit a significant distribution bias toward the original LM distribution in the presence of key collisions. Moreover, achieving a perfect distortion-free watermark is impossible as no statistical signal can be embedded under key collisions. To reduce the distribution bias caused by key collisions, we introduce a new family of distortion-free watermarks--beta-watermark. Experimental results support that the beta-watermark can effectively reduce the distribution bias under key collisions.
VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Models
AI Thrust, Hong Kong University of Science and Technology (Guangzhou), China(香港科技大学(广州)人工智能 thrust);School of Software, BNRist, Tsinghua University, China(清华大学软件学院)
Feature-Aligned Speech Watermarking for Robustness to Reconstruction Distortions
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Shenzhen Key Laboratory of Intelligent Media and Content Understanding(深圳市智能媒体与内容理解重点实验室);Tencent AI Lab(腾讯人工智能实验室)
PMark: Towards Robust and Distortion-free Semantic-level Watermarking with Channel Constraints
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);Peking University(北京大学);National University of Singapore(新加坡国立大学);Tsinghua University(清华大学)
SKeDA: A Generative Watermarking Framework for Text-to-video Diffusion Models
School of Electronic and Information Engineering, Anhui University(安徽大学电子与信息工程学院);Anhui Province Key Laboratory of Digital Security and the CAS Key Laboratory of Electromagnetic Space Information, University of Science and Technology of China(安徽省数字安全重点实验室和中国科学院电磁空间信息重点实验室,中国科学技术大学);School of Computing, National University of Singapore(新加坡国立大学计算机学院)