arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.24982cs.CR
收藏

LiteGuard: 一种高效的无任务模型指纹识别方法,具有增强的泛化能力

LiteGuard: Efficient Task-Agnostic Model Fingerprinting with Enhanced Generalization

Virginia Commonwealth University(弗吉尼亚联邦大学);University of Houston(休斯顿大学)

Guang Yang, Ziye Geng, Yihang Chen, Changqing Luo

AI总结:

本文提出LiteGuard,通过引入检查点模型集增强策略和本地验证器架构,提升模型指纹识别的泛化能力并降低计算成本,实验表明其在泛化性能和计算效率上优于MetaV。

摘要:

任务无关的模型指纹识别最近因其在不同模型架构和任务中的通用框架能力而受到越来越多的关注。当前最先进的方法MetaV通过联合训练一组指纹和基于神经网络的全局验证器,使用两个大规模且多样化的模型集:一个由盗版模型(即受保护模型及其变体)组成,另一个由独立训练的模型组成。然而,在许多现实世界领域,公开可用的模型稀缺,构建此类模型集需要大量训练和计算资源,成为部署的主要障碍。减少模型数量可以减轻开销,但会增加过拟合的风险,而MetaV的纠缠设计进一步加剧了这一问题,因为所有指纹和全局验证器都是联合训练的。过拟合问题会削弱验证未见模型的泛化能力。在本文中,我们提出LiteGuard,一种高效的任务无关指纹识别框架,能够在显著降低计算成本的同时实现增强的泛化能力。具体而言,LiteGuard引入了两个关键创新:(i)基于检查点的模型集增强策略,通过利用每个盗版和独立训练模型训练过程中捕获的中间模型快照来丰富模型多样性,从而减少训练大量此类模型的必要性;(ii)本地验证器架构,将每个指纹与一个轻量级本地验证器配对,从而减少参数纠缠并缓解过拟合。在五个代表性任务上的广泛实验表明,LiteGuard在泛化性能和计算效率上均优于MetaV。

英文摘要:

Task-agnostic model fingerprinting has recently gained increasing attention due to its ability to provide a universal framework applicable across diverse model architectures and tasks. The current state-of-the-art method, MetaV, ensures generalization by jointly training a set of fingerprints and a neural-network-based global verifier using two large and diverse model sets: one composed of pirated models (i.e., the protected model and its variants) and the other comprising independently trained models. However, publicly available models are scarce in many real-world domains, and constructing such model sets requires intensive training and massive computational resources, posing a significant barrier to deployment. Reducing the number of models can alleviate the overhead, but increases the risk of overfitting, a problem further exacerbated by MetaV's entangled design, in which all fingerprints and the global verifier are jointly trained. This overfitting issue compromises the generalization capability for verifying unseen models. In this paper, we propose LiteGuard, an efficient task-agnostic fingerprinting framework that attains enhanced generalization while significantly lowering computational cost. Specifically, LiteGuard introduces two key innovations: (i) a checkpoint-based model set augmentation strategy that enriches model diversity by leveraging intermediate model snapshots captured during training of each pirated and independently trained model, thereby alleviating the need to train a large number of such models, and (ii) a local verifier architecture that pairs each fingerprint with a lightweight local verifier, thereby reducing parameter entanglement and mitigating overfitting. Extensive experiments across five representative tasks show that LiteGuard consistently outperforms MetaV in both generalization performance and computational efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑