arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2206.15433astro-ph.IMastro-ph.COstat.ML
收藏

用变分自增强采样重建宇宙

Reconstructing the Universe with Variational self-Boosted Sampling

Chirag Modi, Yin Li, David Blei

AI总结:

本文提出变分自增强采样(VBS)混合方案,结合变分推断与HMC,通过归一化流学习提议分布以减少MCMC链自相关长度,在宇宙初始条件重建的高维问题中显著提升了采样效率与质量。

摘要:

宇宙学中的正向建模方法使得从观测的巡天数据中重建宇宙初期的初始条件成为可能。然而,参数空间的高维性仍然对探索完整的后验分布构成挑战,传统算法如哈密顿蒙特卡洛(HMC)由于生成相关样本而在计算上效率低下,而变分推断的性能高度依赖于散度(损失)函数的选择。在此,我们开发了一种混合方案,称为变分自增强采样(VBS),通过学习蒙特卡洛采样提议分布的变分近似并将其与HMC结合,来缓解这两种算法的缺点。该变分分布被参数化为一个归一化流,并使用实时生成的样本进行学习,同时从中提取的提议减少了MCMC链中的自相关长度。我们的归一化流使用傅里叶空间卷积和逐元素操作来扩展到高维。我们表明,在短暂的初始预热和训练阶段之后,VBS生成的样本质量优于简单的VI方法,并且在64^3和128^3维问题中探索初始条件后验时,相较于仅使用HMC,将采样阶段的相关长度减少了10到50倍,对于高信噪比的数据观测,增益更大。

英文摘要:

Forward modeling approaches in cosmology have made it possible to reconstruct the initial conditions at the beginning of the Universe from the observed survey data. However the high dimensionality of the parameter space still poses a challenge to explore the full posterior, with traditional algorithms such as Hamiltonian Monte Carlo (HMC) being computationally inefficient due to generating correlated samples and the performance of variational inference being highly dependent on the choice of divergence (loss) function. Here we develop a hybrid scheme, called variational self-boosted sampling (VBS) to mitigate the drawbacks of both these algorithms by learning a variational approximation for the proposal distribution of Monte Carlo sampling and combine it with HMC. The variational distribution is parameterized as a normalizing flow and learnt with samples generated on the fly, while proposals drawn from it reduce auto-correlation length in MCMC chains. Our normalizing flow uses Fourier space convolutions and element-wise operations to scale to high dimensions. We show that after a short initial warm-up and training phase, VBS generates better quality of samples than simple VI approaches and reduces the correlation length in the sampling phase by a factor of 10-50 over using only HMC to explore the posterior of initial conditions in 64$^3$ and 128$^3$ dimensional problems, with larger gains for high signal-to-noise data observations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑