arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.04397cs.CRcs.AI
收藏

深入理解与增强用于DNN模型所有权验证的Proof-of-Training的安全性

Towards Understanding and Enhancing Security of Proof-of-Training for DNN Model Ownership Verification

The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Fujian Normal University(福建师范大学);Jinan University(暨南大学)

Yijia Chang, Hanrui Jiang, Chao Lin, Xinyi Huang, Jian Weng

AI总结:

本文首次采用形式化方法系统分析诚实与伪造训练记录的区别,推导出通用区分标准,并提出基于轨迹匹配算法的通用PoT构造,有效抵御了现有PoT方案无法防范的攻击。

摘要:

深度神经网络(DNN)的巨大经济价值促使AI企业保护这些模型的知识产权(IP)。最近,proof-of-training(PoT)被提出作为DNN IP保护的一种有前景的解决方案,通过它AI企业可以利用DNN训练过程的记录作为其所有权证明。为了防止攻击者伪造所有权证明,安全的PoT方案应该能够区分诚实训练记录和攻击者伪造的记录。尽管现有的PoT方案提供了各种区分标准,但这些标准基于直觉或观察。这些标准的有效性缺乏清晰和全面的分析,导致最初被认为是安全的现有方案很快被简单的想法攻破。在本文中,我们率先以形式化方法识别区分标准,以便明确展示其有效性。具体来说,我们进行系统建模以涵盖广泛的攻击,然后理论分析诚实和伪造训练记录之间的区别。分析结果不仅推导出一个通用的区分标准,而且提供了详细的推理来证明其在防御我们模型所涵盖的攻击方面的有效性。在该标准的指导下,我们提出了一种通用的PoT构造,可以实例化为具体方案。这种构造揭示了以前用于数据蒸馏的轨迹匹配算法在PoT构造中具有显著优势。实验结果表明,我们的方案能够抵抗已经攻破现有PoT方案的攻击,这证明了其在安全性方面的优越性。

英文摘要:

The great economic values of deep neural networks (DNNs) urge AI enterprises to protect their intellectual property (IP) for these models. Recently, proof-of-training (PoT) has been proposed as a promising solution to DNN IP protection, through which AI enterprises can utilize the record of DNN training process as their ownership proof. To prevent attackers from forging ownership proof, a secure PoT scheme should be able to distinguish honest training records from those forged by attackers. Although existing PoT schemes provide various distinction criteria, these criteria are based on intuitions or observations. The effectiveness of these criteria lacks clear and comprehensive analysis, resulting in existing schemes initially deemed secure being swiftly compromised by simple ideas. In this paper, we make the first move to identify distinction criteria in the style of formal methods, so that their effectiveness can be explicitly demonstrated. Specifically, we conduct systematic modeling to cover a wide range of attacks and then theoretically analyze the distinctions between honest and forged training records. The analysis results not only induce a universal distinction criterion, but also provide detailed reasoning to demonstrate its effectiveness in defending against attacks covered by our model. Guided by the criterion, we propose a generic PoT construction that can be instantiated into concrete schemes. This construction sheds light on the realization that trajectory matching algorithms, previously employed in data distillation, possess significant advantages in PoT construction. Experimental results demonstrate that our scheme can resist attacks that have compromised existing PoT schemes, which corroborates its superiority in security.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑