arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.13868cs.CV
收藏

基于粒子滤波的隐式扩散模型在逆问题中的应用

Particle-Filtering-based Latent Diffusion for Inverse Problems

University of Waterloo(滑铁卢大学)

Amir Nazemi, Mohammad Hadi Sepanj, Nicholas Pellegrino, Chris Czarnecki, Paul Fieguth

AI总结:

本文提出基于粒子滤波的隐式扩散(PFLD)框架,用于逆问题求解时探索解空间,实验显示其在FFHQ-1K和ImageNet-1K数据集的三类逆问题任务中优于SoTA求解器PSLD。

摘要:

当前解决基于图像的逆问题的策略会应用隐式扩散模型执行后验采样,但几乎所有方法都未明确尝试探索解空间,仅从高斯分布中抽取单个样本来生成解。本文提出一种基于粒子滤波的框架,用于在反向SDE方法的初始阶段对解空间进行非线性探索。所提出的基于粒子滤波的隐式扩散(PFLD)方法、问题表述及框架可应用于任何基于扩散的线性或非线性逆问题求解方案。实验结果表明,在超分辨率、高斯去模糊和图像修复等逆问题任务中,PFLD在FFHQ-1K和ImageNet-1K数据集上的表现优于当前最优(SoTA)求解器PSLD。

英文摘要:

Current strategies for solving image-based inverse problems apply latent diffusion models to perform posterior sampling.However, almost all approaches make no explicit attempt to explore the solution space, instead drawing only a single sample from a Gaussian distribution from which to generate their solution. In this paper, we introduce a particle-filtering-based framework for a nonlinear exploration of the solution space in the initial stages of reverse SDE methods. Our proposed particle-filtering-based latent diffusion (PFLD) method and proposed problem formulation and framework can be applied to any diffusion-based solution for linear or nonlinear inverse problems. Our experimental results show that PFLD outperforms the SoTA solver PSLD on the FFHQ-1K and ImageNet-1K datasets on inverse problem tasks of super resolution, Gaussian debluring and inpainting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑