arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.22366cs.CVcs.AI
收藏

T2SMark:扩散模型中噪声水印的鲁棒性与多样性平衡

T2SMark: Balancing Robustness and Diversity in Noise-as-Watermark for Diffusion Models

University of Science and Technology of China(中国科学技术大学);Anhui Province Key Laboratory of Digital Security(安徽省数字安全重点实验室);National University of Singapore(新加坡国立大学)

Jindong Yang, Han Fang, Weiming Zhang, Nenghai Yu, Kejiang Chen

AI总结:

针对扩散模型噪声水印中鲁棒性与多样性难以平衡的问题,提出基于尾部截断采样的两阶段水印方案T2SMark,在保留潜在分布的同时增强鲁棒性,实验证明达到最优平衡。

摘要:

近年来,扩散模型发展迅速,能够生成高保真图像,同时也引发了对知识产权保护和生成式人工智能滥用的担忧。针对扩散模型的图像水印技术,特别是噪声即水印(NaW)方法,将水印编码为特定的标准高斯噪声向量用于图像生成,在保持图像质量的同时无缝嵌入信息。检测时,通过反转生成过程恢复包含水印的初始噪声向量,再进行提取。然而,现有的NaW方法难以在鲁棒性和生成多样性之间取得平衡。一些方法通过严格限制初始噪声采样实现强鲁棒性,但降低了用户体验;另一些方法保留多样性,但在实际部署中过于脆弱。为解决这一问题,我们提出T2SMark,一种基于尾部截断采样(TTS)的两阶段水印方案。与先前简单地将比特映射为正负值的方法不同,TTS通过仅在可靠的尾部区域嵌入比特,同时对中心区域进行随机采样以保留潜在分布,从而增强鲁棒性。我们的两阶段框架通过将随机生成的会话密钥集成到两个加密流程中,确保采样多样性。我们在具有U-Net和DiT骨干网络的扩散模型上评估了T2SMark。大量实验表明,该方法在鲁棒性和多样性之间实现了最佳平衡。我们的代码可在https://github.com/0xD009/T2SMark获取。

英文摘要:

Diffusion models have advanced rapidly in recent years, producing high-fidelity images while raising concerns about intellectual property protection and the misuse of generative AI. Image watermarking for diffusion models, particularly Noise-as-Watermark (NaW) methods, encode watermark as specific standard Gaussian noise vector for image generation, embedding the infomation seamlessly while maintaining image quality. For detection, the generation process is inverted to recover the initial noise vector containing the watermark before extraction. However, existing NaW methods struggle to balance watermark robustness with generation diversity. Some methods achieve strong robustness by heavily constraining initial noise sampling, which degrades user experience, while others preserve diversity but prove too fragile for real-world deployment. To address this issue, we propose T2SMark, a two-stage watermarking scheme based on Tail-Truncated Sampling (TTS). Unlike prior methods that simply map bits to positive or negative values, TTS enhances robustness by embedding bits exclusively in the reliable tail regions while randomly sampling the central zone to preserve the latent distribution. Our two-stage framework then ensures sampling diversity by integrating a randomly generated session key into both encryption pipelines. We evaluate T2SMark on diffusion models with both U-Net and DiT backbones. Extensive experiments show that it achieves an optimal balance between robustness and diversity. Our code is available at \href{https://github.com/0xD009/T2SMark}{https://github.com/0xD009/T2SMark}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑