Watermarking approaches are proposed to identify if text being circulated is human or large language model (LLM) generated. The state-of-the-art watermarking strategy of Kirchenbauer et al. (2023a) biases the LLM to generate specific (``green'') tokens. However, determining the robustness of this watermarking method is an open problem. Existing attack methods fail to evade detection for longer text segments. We overcome this limitation, and propose {\em Self Color Testing-based Substitution (SCTS)}, the first ``color-aware'' attack. SCTS obtains color information by strategically prompting the watermarked LLM and comparing output tokens frequencies. It uses this information to determine token colors, and substitutes green tokens with non-green ones. In our experiments, SCTS successfully evades watermark detection using fewer number of edits than related work. Additionally, we show both theoretically and empirically that SCTS can remove the watermark for arbitrarily long watermarked text.
Learning to Evade: Adaptive Attacks on Audio Watermarking
University of Missouri-Kansas City(密苏里大学堪萨斯城分校);University of Hawaii at Manoa(夏威夷大学马诺阿分校);University of South Florida(南佛罗里达大学);Michigan State University(密歇根州立大学);University of Miami(迈阿密大学)
Optimization-Free Universal Watermark Forgery with Regenerative Diffusion Models
Delft University of Technology(代尔夫特理工大学);The Chinese University of Hong Kong(香港中文大学);University of Neuchâtel(Neuchâtel大学);University of Turin(都灵大学);IBM Research(IBM研究院)
Unforgeable Watermarks for Language Models via Robust Signatures
Paul G. Allen School of Computer Science & Engineering, University of Washington(保罗·G·艾伦计算机科学与工程学院,华盛顿大学);Data Science Institute, University of Chicago(数据科学研究所,芝加哥大学)
Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarking
Department of AI, DGIST, Daegu, Republic of Korea(韩国大邱科学技术院人工智能系);Department of EECS, DGIST, Daegu, Republic of Korea(韩国大邱科学技术院电子工程与计算机科学系);ICT convergence, University of Ulsan, Ulsan, Republic of Korea(韩国釜山大学信息通信融合学院)
Large Language Model Watermark Stealing With Mixed Integer Programming
Griffith University(格里菲斯大学);University of Technology, Sydney(悉尼科技大学);Royal Melbourne Institute of Technology(皇家墨尔本理工大学);Huazhong University of Science and Technology(华中科技大学)
DHMark: Public-Key Watermarking for LLM-Generated Text via Diffie-Hellman-Guided Rejection Sampling
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
MacPrompt: Maraconic-guided Jailbreak against Text-to-Image Models
Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University(武汉大学网络安全学院);School of Cyber Science and Engineering, Tianjin University(天津大学网络安全学院)