arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.22700cs.CRcs.AI
收藏

IMMACULATE: 通过可验证计算实现的实用LLM审计框架

IMMACULATE: A Practical LLM Auditing Framework via Verifiable Computation

National University of Singapore(新加坡国立大学);Nanyang Technological University(南洋理工大学);Independent Researcher(独立研究者);University of California, Berkeley(加州大学伯克利分校)

Yanpei Guo, Wenjie Qu, Linyu Wu, Shengfang Zhai, Lionel Z. Wang, Ming Xu, Yue Liu, Binhang Yuan, Dawn Song, Jiaheng Zhang

AI总结:

IMMACULATE通过可验证计算实现对大语言模型的审计,检测模型替换、量化滥用和令牌过账等经济动机驱动的偏差,具有低吞吐量开销和强检测保证。

摘要:

商业大语言模型通常以黑盒API服务形式部署,要求用户信任提供商正确执行推理并诚实报告令牌使用情况。我们提出了IMMACULATE,一个实用的审计框架,能够检测以经济动机驱动的偏差,如模型替换、量化滥用和令牌过账,而无需受信任的硬件或对模型内部的访问。IMMACULATE通过可验证计算选择性地审计少量请求,实现强大的检测保证,同时摊销加密开销。在密集型和MoE模型上的实验表明,IMMACULATE能够可靠地区分良性与恶意执行,且吞吐量开销低于1%。我们的代码已发布在https://github.com/guo-yanpei/Immaculate。

英文摘要:

Commercial large language models are typically deployed as black-box API services, requiring users to trust providers to execute inference correctly and report token usage honestly. We present IMMACULATE, a practical auditing framework that detects economically motivated deviations-such as model substitution, quantization abuse, and token overbilling-without trusted hardware or access to model internals. IMMACULATE selectively audits a small fraction of requests using verifiable computation, achieving strong detection guarantees while amortizing cryptographic overhead. Experiments on dense and MoE models show that IMMACULATE reliably distinguishes benign and malicious executions with under 1% throughput overhead. Our code is published at https://github.com/guo-yanpei/Immaculate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑