Abuse of large language models reveals high risks as large language models are being deployed at an astonishing speed. It is important to protect the model weights to avoid malicious usage that violates licenses of open-source large language models. This paper proposes a novel watermarking strategy that plants watermarks in the quantization process of large language models without pre-defined triggers during inference. The watermark works when the model is used in the fp32 mode and remains hidden when the model is quantized to int8, in this way, the users can only inference the model without further supervised fine-tuning of the model. We successfully plant the watermark into open-source large language model weights including GPT-Neo and LLaMA. We hope our proposed method can provide a potential direction for protecting model weights in the era of large language model applications.
Towards Codable Watermarking for Injecting Multi-bits Information to LLMs
National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University(北京大学计算机学院多媒体信息处理国家重点实验室);Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Pattern Recognition Center, WeChat AI, Tencent Inc.(腾讯公司微信AI模式识别中心);DeepSeek AI(深度求索人工智能公司)
A Survey of Text Watermarking in the Era of Large Language Models
Tsinghua University(清华大学);The Chinese University of Hong Kong(香港中文大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Beijing University of Posts and Telecommunications(北京邮电大学);University of Illinois Chicago(芝加哥大学伊利诺伊分校)
Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarking
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Tsinghua University(清华大学);The Hong Kong University of Science and Technology(香港科技大学)
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络与信息安全学院)
Linear Ensembles Wash Away Watermarks: On the Fragility of Distributional Perturbations in LLMs
Department of Informatics, King's College London, UK(伦敦国王学院信息学院);Department of Mathematics, Imperial College London, UK(伦敦帝国学院数学系);Department of Statistics, University of Warwick, UK(沃里克大学统计系)
Building Intelligence Identification System via Large Language Model Watermarking: A Survey and Beyond
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);School of Cyber Science and Engineering, Shanghai Jiao Tong University(上海交通大学网络空间安全学院);Tsinghua University(清华大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
From Trade-off to Synergy: A Versatile Symbiotic Watermarking Framework for Large Language Models
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);Hainan Province Fang Binxing Academician Workstation(海南省方斌星院士工作站)
Can Watermarked LLMs be Identified by Users via Crafted Prompts?
Tsinghua University(清华大学);Beijing University of Posts and Telecommunications(北京邮电大学);The Chinese University of Hongkong(香港中文大学);University of Illinois at Chicago(伊利诺伊大学芝加哥分校);Hongkong University of Science and Technology (Guangzhou)(香港科技大学(广州))
Implicit Identity Technologies for LLMs: Fingerprinting and Watermarking across Datasets, Models, and Generated Content
School of Cyber Science and Engineering, Xi’an Jiaotong University, Xi’an, China(西安交通大学计算机科学与工程学院);State Grid Henan Marketing Service Center, Henan, China(国网河南营销服务中心);Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China(中国科学院大学网络安全学院);School of Information Technology, Deakin University, Geelong, Australia(迪金大学信息技术学院)
School of Communication and Information Engineering, Shanghai University(上海大学通信与信息工程学院);School of Big Data and Computer Science, Guizhou Normal University(贵州师范大学大数据与计算机科学学院)
Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarking
Department of AI, DGIST, Daegu, Republic of Korea(韩国大邱科学技术院人工智能系);Department of EECS, DGIST, Daegu, Republic of Korea(韩国大邱科学技术院电子工程与计算机科学系);ICT convergence, University of Ulsan, Ulsan, Republic of Korea(韩国釜山大学信息通信融合学院)