用于从涉及幂和的密度进行模拟的混合表示的综述与演示
Review and Demonstration of a Mixture Representation for Simulation from Densities Involving Sums of Powers
AI总结:
本文综述并演示 Devroye(2009)的潜变量混合表示,以支持在 $0<q<2$ 时从含幂和惩罚项的贝叶斯后验中采样。
摘要:
惩罚回归和稳健回归,尤其是从贝叶斯视角处理时,可能涉及从后验分布中模拟随机变量 $\boldsymbol z$ 的问题,该后验分布在对数尺度上包含一个与幂和 $\\|\boldsymbol z\\|_q^q$ 成比例的项。然而,许多常用的基于梯度的 Markov Chain Monte Carlo 方法通过 Hamiltonian Monte Carlo 从此类后验分布进行模拟,因此要求非归一化后验分布满足可微性条件,而当 $q \leq 1$ 时这些条件并不成立(Plummer,2023)。这构成了限制;$q \leq 1$ 的情形包含广泛使用的诱导稀疏性惩罚回归模型和重尾稳健回归模型。在 $q=1$ 的特殊情形下,一种有助于从此类后验分布进行模拟的潜变量表示已广为人知。然而,$q<1$ 的情形尚未得到同样充分的研究。在本短文中,我们综述了 Devroye(2009)所述潜变量表示的可用性,展示了在 $0<q<2$ 时如何利用它从此类后验分布进行模拟,并在估计贝叶斯惩罚回归模型参数的背景下演示了其实用性。
英文摘要:
Penalized and robust regression, especially when approached from a Bayesian perspective, can involve the problem of simulating a random variable $\boldsymbol z$ from a posterior distribution that includes a term proportional to a sum of powers, $\|\boldsymbol z \|^q_q$, on the log scale. However, many popular gradient-based methods for Markov Chain Monte Carlo simulation from such posterior distributions use Hamiltonian Monte Carlo and accordingly require conditions on the differentiability of the unnormalized posterior distribution that do not hold when $q \leq 1$ (Plummer, 2023). This is limiting; the setting where $q \leq 1$ includes widely used sparsity inducing penalized regression models and heavy tailed robust regression models. In the special case where $q = 1$, a latent variable representation that facilitates simulation from such a posterior distribution is well known. However, the setting where $q < 1$ has not been treated as thoroughly. In this note, we review the availability of a latent variable representation described in Devroye (2009), show how it can be used to simulate from such posterior distributions when $0 < q < 2$, and demonstrate its utility in the context of estimating the parameters of a Bayesian penalized regression model.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。