基于引导扩散的空间预测
Spatial Prediction with Guided Diffusion
AI总结:
本文提出将机器学习的引导扩散建模用于空间预测,可处理多种过程与数据模型,在模拟和甲烷通量反演实验中表现良好,适用于MCMC难处理的模型且扩展性佳。
摘要:
空间预测是涉及空间或时空参考数据的数据分析中一项至关重要的任务,通常采用分层模型完成,这类模型包含描述目标潜在过程的过程模型,以及描述该过程如何被观测的数据模型。目标量是预测分布,即给定观测数据后潜在空间过程的条件分布。遗憾的是,预测分布极少有闭式形式,且难以从中采样。本文展示了机器学习领域近期的引导扩散建模进展,如何在数据模型导出的似然函数已知且可微(可能需经松弛处理)时,解决广泛类别的空间预测问题。为展示该方法的通用性,我们将其应用于高斯和非高斯过程模型,以及多种数据模型,这些数据模型描述了直接部分观测、线性和面状聚合、计数、右删失和面积超限泛函。在可行的情况下,我们将该框架与精确预测分布及马尔可夫链蒙特卡洛(MCMC)导出的预测分布进行验证。我们在多项模拟研究,以及英国和爱尔兰上空甲烷通量反演的受控实验中验证了该方法。结果表明,引导扩散可在多种场景下从正确的预测分布中采样,可应用于MCMC难以处理的模型,且能随潜在过程的维度良好扩展。
英文摘要:
Spatial prediction is a critically important task in data analyses that involve spatially or spatio-temporally-referenced data. It is commonly carried out using hierarchical models, which comprise a process model describing the latent process of interest, and a data model describing how the process is observed. The target quantity is the predictive distribution, which is the conditional distribution of the latent spatial process given the observed data. Unfortunately, the predictive distribution is rarely available in closed form and can be difficult to sample from. Here, we show how recent developments in guided diffusion modelling from machine learning can address a wide class of problems in spatial prediction when the likelihood function derived from the data model is known and differentiable, possibly after relaxation. To show the versatility of the approach, we apply it to both Gaussian and non-Gaussian process models and a variety of data models that describe direct partial observations, linear and areal aggregates, counts, right censoring, and area-exceedance functionals. Where possible, we validate the framework against exact and Markov-chain-Monte-Carlo (MCMC)-derived predictive distributions. We demonstrate our approach on several simulation studies and in a controlled experiment of methane-flux inversion over the UK and Ireland. We show that guided diffusion can sample from the correct predictive distribution in a variety of settings, that it can be applied to models where MCMC is intractable, and that it scales well with the dimensionality of the latent process.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。