arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1406.5706math.STcs.LGstat.MLstat.TH
收藏

一阶稳定样条核的最大熵性质及其意义

On the Maximum Entropy Property of the First-Order Stable Spline Kernel and its Implications

University of Liège(列日大学);University of Cambridge(剑桥大学)

Francesca Paola Carli

摘要:

最近提出了一种新的系统辨识的非参数方法,其中冲激响应被看作是一个零均值高斯过程的实现,其协方差,即所谓的稳定样条核,保证了冲激响应几乎必然是稳定的。稳定样条核的最大熵性质已在文献中指出。在本文中,我们提供了一个独立的证明,依赖于矩阵论扩展问题的图形模型文献,并导致一个封闭的形式表达的逆的一阶稳定样条核,以及一个新的因式分解的形式$UWU^\top$与$U$上三角和$W$对角线。有趣的是,所有的一阶稳定样条核共享相同的因子$U$和$W$承认一个封闭的形式表示的内核超参数,使因式分解计算成本低廉。稳定样条核的最大似然特性也突出显示。这些结果可用于提高稳定性和减少与稳定样条估计的计算相关的计算复杂性。

英文摘要:

A new nonparametric approach for system identification has been recently proposed where the impulse response is seen as the realization of a zero--mean Gaussian process whose covariance, the so--called stable spline kernel, guarantees that the impulse response is almost surely stable. Maximum entropy properties of the stable spline kernel have been pointed out in the literature. In this paper we provide an independent proof that relies on the theory of matrix extension problems in the graphical model literature and leads to a closed form expression for the inverse of the first order stable spline kernel as well as to a new factorization in the form $UWU^\top$ with $U$ upper triangular and $W$ diagonal. Interestingly, all first--order stable spline kernels share the same factor $U$ and $W$ admits a closed form representation in terms of the kernel hyperparameter, making the factorization computationally inexpensive. Maximum likelihood properties of the stable spline kernel are also highlighted. These results can be applied both to improve the stability and to reduce the computational complexity associated with the computation of stable spline estimators.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑