应用于偏微分方程的扩散模型的软约束去噪器
Softly Constrained Denoisers for Diffusion Models Applied to Partial Differential Equations
AI总结:
提出在扩散模型的去噪器中引入基于偏微分方程的软归纳偏置,以在提高约束遵从性的同时保持对模型错误指定的适应性。
摘要:
扩散模型已成为偏微分方程解的强大生成先验。现有方法通过将PDE残差添加为损失正则化器或通过推理时调整来强制执行物理约束。这些方法使模型偏离真实数据分布,当控制PDE被错误指定时尤其成问题。为了规避这些问题同时充分利用PDE约束,我们在从PDE导出的去噪器架构中引入软归纳偏置。我们表明,这些软约束去噪器利用约束知识来改善对标准去噪器的遵从性,同时在相对于观测数据存在错误指定的情况下保持足够的灵活性以偏离它。
英文摘要:
Diffusion models have become a powerful generative prior for solutions of partial differential equations (PDEs). Existing approaches enforce physical constraints either by adding the PDE residuals as loss regularizers or through inference-time adjustments. These methods bias the model away from the true data distribution, which is especially problematic when the governing PDE is misspecified. To circumvent these issues while making the most out of the PDE constraint, we introduce soft inductive biases into the denoiser architecture derived from the PDEs. We show that these softly constrained denoisers exploit constraint knowledge to improve compliance over standard denoisers, while maintaining enough flexibility to deviate from it in case of misspecification with respect to observed data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。