The behavior of LLMs does not depend solely on the model itself. Components of the inference system, such as the inference engine, attention backend, and hardware platform, subtly influence how inputs are processed. These components differ in their implementations and thereby induce small numerical deviations across systems when running the same model. While prior work has established the theoretical existence of such deviations, their security implications have remained unexplored. In this paper, we show that these deviations are characteristic of specific components and propagate to observable textual outputs, exposing the inference system to any party that can query the model. Building on this observation, we introduce a fingerprinting method that analyzes the prompt-response behavior of LLMs to identify components of the inference system. Our empirical evaluation demonstrates that the inference engine, attention backend, and underlying hardware platform can be identified reliably, even when the LLM is operated at non-zero temperature. We show that preventing fingerprinting is fundamentally hard, as it would require eliminating numerical differences between hardware and software stacks. We therefore propose partial mitigations and discuss their impact.
KinGuard: Hierarchical Kinship-Aware Fingerprinting to Defend Against Large Language Model Stealing
Zhejiang University(浙江大学);The University of Melbourne(墨尔本大学);National University of Singapore(新加坡国立大学);People’s Public Security University of China(中国人民公安大学);Shanghai Jiao Tong University(上海交通大学)
Pareto-Secure Machine Learning (PSML): Fingerprinting and Securing Inference Serving Systems
Georgia Institute of Technology(佐治亚理工学院);University of California, Riverside(加州大学河滨分校);University of Wisconsin–Madison(威斯康星大学麦迪逊分校);University of Virginia(弗吉尼亚大学);George Washington University(乔治华盛顿大学)
AttnDiff: Attention-based Differential Fingerprinting for Large Language Models
Zhejiang University of Technology(浙江工业大学);Zhejiang University(浙江大学);Binjiang Institute of Zhejiang University(浙江大学滨江研究院);Shanghai Jiao Tong University(上海交通大学);University of Science and Technology of China(中国科学技术大学)
DNF: Dual-Layer Nested Fingerprinting for Large Language Model Intellectual Property Protection
Zhejiang University(浙江大学);Binjiang Institute of Zhejiang University(浙江大学滨江学院);Hangzhou Dianzi University(杭州电子科技大学);Hefei University of Technology(合肥工业大学)
SoK: Large Language Model Copyright Auditing via Fingerprinting
The State Key Laboratory of Blockchain and Data Security(区块链与数据安全国家重点实验室);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新技术区(滨江)区块链与数据安全研究院);Nanyang Technological University(南洋理工大学);City University of Hong Kong(香港城市大学);Sun Yat-Sen University(中山大学)
LLMs Have Rhythm: Fingerprinting Large Language Models Using Inter-Token Times and Network Traffic Analysis
College of Science and Engineering (CSE), Hamad Bin Khalifa University (HBKU)(哈马德·本·卡伊夫大学科学与工程学院);Networked Systems Security Group, KTH Royal Institute of Technology -- Stockholm, Sweden(瑞典皇家理工学院网络系统安全组)
Implicit Identity Technologies for LLMs: Fingerprinting and Watermarking across Datasets, Models, and Generated Content
School of Cyber Science and Engineering, Xi’an Jiaotong University, Xi’an, China(西安交通大学计算机科学与工程学院);State Grid Henan Marketing Service Center, Henan, China(国网河南营销服务中心);Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China(中国科学院大学网络安全学院);School of Information Technology, Deakin University, Geelong, Australia(迪金大学信息技术学院)
FDLLM: A Dedicated Detector for Black-Box LLMs Fingerprinting
College of Cyberspace Security, Hainan University(海南大学网络安全学院);National Computer Network Intrusion Protection Center, University of Chinese Academy of Sciences(中国科学院大学国家计算机网络入侵防护中心);Graduate School of Natural Science and Technology, Kanazawa University(北九州市立大学自然科学技术研究生院);School of Cyber Engineering, Xidian University(西安电子科技大学 cyber 工程学院);School of Informatics, Computing, and Cyber Systems, Northern Arizona University(北亚利桑那大学信息学、计算与网络系统学院);College of IST, Pennsylvania State University(宾夕法尼亚州立大学信息科技学院)