We study geometric ergodicity of the Gibbs sampler for linear latent non-Gaussian models (LLnGMs), a class of hierarchical models in which conditional Gaussian structure is preserved through generalized inverse Gaussian (GIG) variance-mixture augmentation. Two complementary routes to geometric ergodicity are developed for the marginal chain on the mixing variables. First, we show that the associated Markov operator is trace-class, and hence admits a spectral gap, over a large portion of the GIG parameter space. Second, for the remaining boundary and heavy-tail regimes, we establish geometric ergodicity via drift and minorization, subject to an explicit null-smallness condition that quantifies how the drift interacts with the null space of the observation operator. Together, these results cover the full GIG parameter space, including the normal-inverse Gaussian, generalized asymmetric Laplace, and Student-$t$ special cases. The geometric ergodicity of this chain underpins the consistency of Gibbs-based stochastic-gradient estimators for maximum likelihood estimation, and we provide conditions that make the required integrability checks transparent. Numerical experiments illustrate the theoretical findings, contrasting mixing efficiency across parameter regimes and probing the role of the null-smallness constant.
Geometric ergodicity of Polya-Gamma Gibbs sampler for Bayesian logistic regression with a flat prior
逻辑斯谛回归模型是分析二进制数据最常用的模型。在贝叶斯逻辑斯谛回归模型中,在没有先验信息的情况下,回归系数往往采用不适当的平坦先验。由此产生的顽固性后壁密度可以通过运行Polson et al.的(2013)数据增强(DA)算法。在本文中,我们建立了马尔可夫链的基础上Polson等人。的(2013)DA算法是几何遍历的。证明这一理论结果具有重要的实际意义,因为它保证了有限二阶矩条件下样本平均值的中心极限定理的存在性。CLT又允许DA算法的用户计算后验估计的标准误差。
Blocking Strategies and Stability of Particle Gibbs Samplers
在马尔可夫链蒙特卡罗方法的背景下,从隐马尔可夫模型的潜在状态的条件(或后验)概率分布中采样,给定所观察的过程的实现,是一个非平凡的问题。为此,Andrieu et al.(2010)构建了一个马尔可夫核,使用粒子滤波器保持这个条件分布不变。从从业者的角度来看,这个马尔可夫内核试图模拟的行为采样所有的潜在状态变量作为一个块从后验分布,但模型的精确模拟是不可能的。有一些最近的理论结果,建立了均匀遍历的马尔可夫核,混合率不会减少提供的粒子数至少线性增长的数量在后的潜在状态。这导致了内核的每次应用的成本,即潜在状态的数量是二次的,这对于长观测序列来说可能是禁止的。我们试图回答一个明显但重要的问题:是否有一个不同的实现,其每次迭代的成本随潜在状态的数量线性增长,但在这个意义上仍然是稳定的,它的混合率不会恶化?我们解决这个问题,使用阻塞策略,这是很容易并行化,并证明稳定的采样器。