arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2306.11652stat.COstat.ME
收藏

线性高斯状态空间模型中参数的稀疏贝叶斯估计

Sparse Bayesian Estimation of Parameters in Linear-Gaussian State-Space Models

Benjamin Cox, Victor Elvira

AI总结:

针对线性高斯状态空间模型中难以估计的稀疏转移矩阵,提出全概率贝叶斯方法SpaRJ,通过遍历不同稀疏模式获取后验稀疏样本,具有理论保证并提升可解释性,在144维参数空间和真实数据上验证了性能。

摘要:

状态空间模型(SSMs)是一种通过潜在状态对时变系统进行建模的强大统计工具。在这些模型中,潜在状态从未被直接观测到。相反,我们获得与状态相关的一系列数据点。线性高斯状态空间模型被广泛使用,因为当所有模型参数已知时,它允许精确推断,然而这种情况很少见。这些参数的估计是一项极具挑战性但必不可少的任务,用于执行推断和预测。在线性高斯模型中,状态动态通过状态转移矩阵来描述。已知该模型参数难以估计,因为它编码了状态元素之间的关系,而这些关系从未被观测到。在许多应用中,该转移矩阵是稀疏的,因为并非所有状态分量都直接影响所有其他状态分量。然而,大多数参数估计方法并未利用这一特性。在这项工作中,我们提出了SpaRJ,一种完全概率化的贝叶斯方法,它从转移矩阵的后验分布中获取稀疏样本。我们的方法通过遍历一组在转移矩阵中表现出不同稀疏模式的模型来探索稀疏性。此外,我们还设计了新的有效规则来探索同一稀疏度水平内的转移矩阵。这种新颖的方法具有强大的理论保证,并揭示了数据生成过程的潜在结构,从而增强了可解释性。SpaRJ的性能在参数空间维度为144的示例以及一个使用真实数据的数值示例中得到了展示。

英文摘要:

State-space models (SSMs) are a powerful statistical tool for modelling time-varying systems via a latent state. In these models, the latent state is never directly observed. Instead, a sequence of data points related to the state are obtained. The linear-Gaussian state-space model is widely used, since it allows for exact inference when all model parameters are known, however this is rarely the case. The estimation of these parameters is a very challenging but essential task to perform inference and prediction. In the linear-Gaussian model, the state dynamics are described via a state transition matrix. This model parameter is known to behard to estimate, since it encodes the relationships between the state elements, which are never observed. In many applications, this transition matrix is sparse since not all state components directly affect all other state components. However, most parameter estimation methods do not exploit this feature. In this work we propose SpaRJ, a fully probabilistic Bayesian approach that obtains sparse samples from the posterior distribution of the transition matrix. Our method explores sparsity by traversing a set of models that exhibit differing sparsity patterns in the transition matrix. Moreover, we also design new effective rules to explore transition matrices within the same level of sparsity. This novel methodology has strong theoretical guarantees, and unveils the latent structure of the data generating process, thereby enhancing interpretability. The performance of SpaRJ is showcased in example with dimension 144 in the parameter space, and in a numerical example with real data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑