arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.02467cs.LGcs.CRcs.CV
收藏

SIDE:从扩散模型中提取代理条件数据

SIDE: Surrogate Conditional Data Extraction from Diffusion Models

Fudan University(复旦大学);University of Hong Kong(香港大学)

Yunhao Chen, Shujie Wang, Difan Zou, Xingjun Ma

AI总结:

本研究提出SIDE框架,通过构建代理条件从非条件扩散模型中定向提取训练数据,打破非条件模型安全的假设,并通过理论证明所有条件化都会放大记忆效应,重新定义扩散模型隐私威胁基准。

摘要:

随着扩散概率模型(DPMs)成为生成式AI(GenAI)的核心,理解其记忆行为对于评估数据泄露、版权侵权和可信度等风险至关重要。现有研究发现条件DPM极易受到使用显式提示的数据提取攻击,而非条件模型通常被认为是安全的。我们提出代理条件数据提取(SIDE)框架来挑战这一观点,该通用框架构建数据驱动的代理条件,可从任意DPM中进行定向提取。通过在CIFAR-10、CelebA、ImageNet和LAION-5B上的大量实验,我们表明SIDE能成功从所谓安全的非条件模型中提取训练数据,即使在条件模型上也优于基线攻击方法。作为补充,我们提出了基于信息标签的统一理论框架,证明所有形式的条件化(无论是显式还是代理的)都会放大记忆效应。我们的工作重新定义了DPM的威胁格局,确立了精确条件化是一项根本漏洞,并为模型隐私评估设定了新的更强基准。

英文摘要:

As diffusion probabilistic models (DPMs) become central to Generative AI (GenAI), understanding their memorization behavior is essential for evaluating risks such as data leakage, copyright infringement, and trustworthiness. While prior research finds conditional DPMs highly susceptible to data extraction attacks using explicit prompts, unconditional models are often assumed to be safe. We challenge this view by introducing \textbf{Surrogate condItional Data Extraction (SIDE)}, a general framework that constructs data-driven surrogate conditions to enable targeted extraction from any DPM. Through extensive experiments on CIFAR-10, CelebA, ImageNet, and LAION-5B, we show that SIDE can successfully extract training data from so-called safe unconditional models, outperforming baseline attacks even on conditional models. Complementing these findings, we present a unified theoretical framework based on informative labels, demonstrating that all forms of conditioning, explicit or surrogate, amplify memorization. Our work redefines the threat landscape for DPMs, establishing precise conditioning as a fundamental vulnerability and setting a new, stronger benchmark for model privacy evaluation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑