arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1406.2839stat.COstat.ML
收藏

非正态化统计模型的Poisson变换

The Poisson transform for unnormalised statistical models

Simon Barthelmé, Nicolas Chopin

摘要:

与标准统计模型相反,非归一化统计模型仅指定直到常数的似然函数。虽然这些模型是自然和流行的,但缺乏规范化使得推理更加困难。在这里,我们表明,推断一个空间$Ω$上的非归一化模型的参数可以映射到一个等价的问题,估计强度的泊松点过程$Ω$。未归一化的统计模型现在指定不需要被归一化的强度函数。实际上,归一化常数现在可以被推断为另一个参数,而不会丢失信息。结果可以扩展到覆盖非IID模型,其包括例如用于图序列(动态图)或用于二进制向量序列的非归一化模型。因此,我们证明了非IID模型中的非归一化参数推断可以转化为半参数估计问题。此外,我们证明了Gutmann & Hyvärinen(2012)的噪声对比发散可以理解为泊松变换的近似,并扩展到非IID设置。我们使用我们的结果来拟合眼球运动的空间马尔可夫链模型,其中泊松变换使我们能够将高度非标准的模型转化为香草半参数逻辑斯谛回归。

英文摘要:

Contrary to standard statistical models, unnormalised statistical models only specify the likelihood function up to a constant. While such models are natural and popular, the lack of normalisation makes inference much more difficult. Here we show that inferring the parameters of a unnormalised model on a space $Ω$ can be mapped onto an equivalent problem of estimating the intensity of a Poisson point process on $Ω$. The unnormalised statistical model now specifies an intensity function that does not need to be normalised. Effectively, the normalisation constant may now be inferred as just another parameter, at no loss of information. The result can be extended to cover non-IID models, which includes for example unnormalised models for sequences of graphs (dynamical graphs), or for sequences of binary vectors. As a consequence, we prove that unnormalised parameteric inference in non-IID models can be turned into a semi-parametric estimation problem. Moreover, we show that the noise-contrastive divergence of Gutmann & Hyvärinen (2012) can be understood as an approximation of the Poisson transform, and extended to non-IID settings. We use our results to fit spatial Markov chain models of eye movements, where the Poisson transform allows us to turn a highly non-standard model into vanilla semi-parametric logistic regression.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑