arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.00772cs.LG
收藏

大语言模型的可证模型来源集

Provable Model Provenance Set for Large Language Models

Department of Statistics and Data Science, Southern University of Science and Technology, Shenzhen, China(统计与数据科学系,南方科技大学,深圳,中国)

Xiaoqi Qiu, Hao Zeng, Zhiyu Hou, Hongxin Wei

AI总结:

本文提出了一种可证明保证的模型来源集,通过顺序测试和排除方法实现可靠来源覆盖,适用于大语言模型的归因与审计任务。

摘要:

随着未经授权的模型使用和误归因现象的增加,对可靠模型来源分析的需求日益增长。然而,现有方法大多依赖于启发式的指纹匹配规则,缺乏可证明的误差控制,并且往往忽略了多个来源的存在,使它们的来源声明可靠性未得到验证。在本文中,我们首先用可证明的保证形式化了模型来源问题,要求在规定置信水平下严格覆盖所有真实来源。然后,我们提出了模型来源集(MPS),它采用顺序测试和排除程序,自适应地构建一个满足保证的小集合。MPS的关键思想是测试候选池中来源存在的显著性,从而在用户指定的置信水平下建立可证明的渐近保证。广泛的实验表明,MPS能够有效实现目标来源覆盖,同时严格限制无关模型的包含,并进一步揭示了其在归因和审计任务中的潜在应用价值。

英文摘要:

The growing prevalence of unauthorized model usage and misattribution has increased the need for reliable model provenance analysis. However, existing methods largely rely on heuristic fingerprint-matching rules that lack provable error control and often overlook the existence of multiple sources, leaving the reliability of their provenance claims unverified. In this work, we first formalize the model provenance problem with provable guarantees, requiring rigorous coverage of all true provenances at a prescribed confidence level. Then, we propose the Model Provenance Set (MPS), which employs a sequential test-and-exclusion procedure to adaptively construct a small set satisfying the guarantee. The key idea of MPS is to test the significance of provenance existence within a candidate pool, thereby establishing a provable asymptotic guarantee at a user-specific confidence level. Extensive experiments demonstrate that MPS effectively achieves target provenance coverage while strictly limiting the inclusion of unrelated models, and further reveal its potential for practical provenance analysis in attribution and auditing tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑