arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1303.0268math.STstat.MLstat.TH
收藏

神经网络统计模型的最大信息散度

Maximal Information Divergence from Statistical Models defined by Neural Networks

Guido Montufar, Johannes Rauh, Nihat Ay

摘要:

我们回顾了最近的结果Kullback-Leibler信息散度的最大值从统计模型定义的神经网络,包括朴素贝叶斯模型,限制玻尔兹曼机,深度信念网络,和各类指数族。我们说明的方法来计算从一个给定的模型从简单的子或超级模型的最大分歧。本文给出了有限值单位的深窄信度网的一个新结果。

英文摘要:

We review recent results about the maximal values of the Kullback-Leibler information divergence from statistical models defined by neural networks, including naive Bayes models, restricted Boltzmann machines, deep belief networks, and various classes of exponential families. We illustrate approaches to compute the maximal divergence from a given model starting from simple sub- or super-models. We give a new result for deep and narrow belief networks with finite-valued units.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑