To mitigate potential risks associated with language models, recent AI detection research proposes incorporating watermarks into machine-generated text through random vocabulary restrictions and utilizing this information for detection. While these watermarks only induce a slight deterioration in perplexity, our empirical investigation reveals a significant detriment to the performance of conditional text generation. To address this issue, we introduce a simple yet effective semantic-aware watermarking algorithm that considers the characteristics of conditional text generation and the input context. Experimental results demonstrate that our proposed method yields substantial improvements across various text generation models, including BART and Flan-T5, in tasks such as summarization and data-to-text generation while maintaining detection ability.
A Survey of Text Watermarking in the Era of Large Language Models
Tsinghua University(清华大学);The Chinese University of Hong Kong(香港中文大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Beijing University of Posts and Telecommunications(北京邮电大学);University of Illinois Chicago(芝加哥大学伊利诺伊分校)
Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarking
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Tsinghua University(清华大学);The Hong Kong University of Science and Technology(香港科技大学)
Revealing Weaknesses in Text Watermarking Through Self-Information Rewrite Attacks
University of British Columbia(不列颠哥伦比亚大学);Vector Institute for AI(向量人工智能研究所);University of Cambridge(剑桥大学);Canada CIFAR AI Chair(加拿大CIFAR人工智能主席);NSERC CRC Chair(NSERC加拿大研究主席)