arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.12403stat.COstat.ML
收藏

抽样约束连续概率分布研究进展

Sampling Constrained Continuous Probability Distributions: A Review

Shiwei Lan, Lulu Kang

摘要:

约束连续分布的抽样问题经常出现在许多机器/统计学习模型中。许多蒙特卡罗马尔可夫链(MCMC)抽样方法已被修改,以处理不同类型的约束的随机变量。在这些方法中,汉密尔顿蒙特卡罗(HMC)和相关的方法已显示出显着的优势,在计算效率方面相比,其他同行。本文首先回顾了HMC和一些扩展的采样方法,然后具体介绍了三种基于约束HMC的采样方法:反射、重构和球面HMC。为了说明,我们应用这些方法来解决三个著名的约束抽样问题,截断多元正态分布,贝叶斯正则化回归,和非参数密度估计。在这篇综述中,我们还将约束抽样与约束设计空间的试验统计设计中的另一个类似问题联系起来。

英文摘要:

The problem of sampling constrained continuous distributions has frequently appeared in many machine/statistical learning models. Many Monte Carlo Markov Chain (MCMC) sampling methods have been adapted to handle different types of constraints on the random variables. Among these methods, Hamilton Monte Carlo (HMC) and the related approaches have shown significant advantages in terms of computational efficiency compared to other counterparts. In this article, we first review HMC and some extended sampling methods, and then we concretely explain three constrained HMC-based sampling methods, reflection, reformulation, and spherical HMC. For illustration, we apply these methods to solve three well-known constrained sampling problems, truncated multivariate normal distributions, Bayesian regularized regression, and nonparametric density estimation. In this review, we also connect constrained sampling with another similar problem in the statistical design of experiments of constrained design space.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑