arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.09434cs.CRcs.AI
收藏

大型语言模型的行为指纹:通过拒绝向量进行溯源追踪

A Behavioral Fingerprint for Large Language Models: Provenance Tracking via Refusal Vectors

Department of Computer Science, Texas Tech University(计算机科学系,塔尔萨大学)

Zhenyu Xu, Victor S. Sheng

AI总结:

本文提出通过拒绝向量进行大型语言模型溯源追踪的方法,开发了稳健的行为指纹系统,并验证其在知识产权保护中的有效性。

摘要:

保护大型语言模型(LLMs)的知识产权是一个关键挑战,由于未经授权的衍生模型 proliferate。我们引入了一种新的指纹框架,利用安全对齐诱导的行为模式,应用拒绝向量的概念进行LLM溯源追踪。这些向量是从模型内部表示在处理有害和无害提示时的方向模式中提取的,用作稳健的行为指纹。我们的贡献在于围绕这一概念开发了一个指纹系统,并进行了广泛验证其在知识产权保护中的有效性。我们证明这些行为指纹对常见的修改具有高度鲁棒性,包括微调、合并和量化。我们的实验显示,指纹独特于每个模型家族,独立训练的模型之间余弦相似度较低。在涉及76个后代模型的大规模识别任务中,我们的方法在识别正确基模型家族上实现了100%的准确率。此外,我们分析了指纹在对齐破坏攻击下的行为,发现虽然性能显著下降,但仍有可检测的痕迹。最后,我们提出一个理论框架,将此私有指纹转换为可公开验证、隐私保护的 artifact,使用局部敏感哈希和零知识证明。

英文摘要:

Protecting the intellectual property of large language models (LLMs) is a critical challenge due to the proliferation of unauthorized derivative models. We introduce a novel fingerprinting framework that leverages the behavioral patterns induced by safety alignment, applying the concept of refusal vectors for LLM provenance tracking. These vectors, extracted from directional patterns in a model's internal representations when processing harmful versus harmless prompts, serve as robust behavioral fingerprints. Our contribution lies in developing a fingerprinting system around this concept and conducting extensive validation of its effectiveness for IP protection. We demonstrate that these behavioral fingerprints are highly robust against common modifications, including finetunes, merges, and quantization. Our experiments show that the fingerprint is unique to each model family, with low cosine similarity between independently trained models. In a large-scale identification task across 76 offspring models, our method achieves 100\% accuracy in identifying the correct base model family. Furthermore, we analyze the fingerprint's behavior under alignment-breaking attacks, finding that while performance degrades significantly, detectable traces remain. Finally, we propose a theoretical framework to transform this private fingerprint into a publicly verifiable, privacy-preserving artifact using locality-sensitive hashing and zero-knowledge proofs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑