arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1910.09417cs.LGcs.AIstat.ML
收藏

最大概率定理:概率学习的框架

Maximum Probability Theorem: A Framework for Probabilistic Learning

University of Central Florida(中佛罗里达大学);Northwestern University(西北大学)

Amir Emad Marvasti, Ehsan Emad Marvasti, Ulas Bagci, Hassan Foroosh

摘要:

我们提出了一个理论框架的概率学习所得出的最大概率(MP)定理在当前的文件。在这个概率框架中,模型被定义为概率空间中的事件,并且模型或相关事件-真实的基础模型或参数化模型-具有量化的概率度量。模型的概率测度的这种量化是由MP定理导出的,在MP定理中,我们已经证明了事件的概率测度在任意随机变量的条件分布下具有上限。通过这种替代框架,模型参数的概念包含在模型或相关事件的定义中。因此,该框架偏离了传统的假设模型参数先验的方法。相反,通过最大化模型的概率或根据信息论,最小化模型的信息内容,可以看到假设先验参数的正则化效果。在我们的框架中,模型的概率对于重新参数化是不变的,并且仅依赖于模型的似然函数。此外,而不是最大化后验在传统的贝叶斯设置,在我们的替代框架的目标函数被定义为集合操作(如交集)的真实基础模型的事件和事件的模型在手的概率。我们的理论框架,作为MP定理的推导,通过巩固概率模型的定义,量化它们的概率,并提供对目标函数的直观理解,增加了概率学习的清晰度。

英文摘要:

We present a theoretical framework of probabilistic learning derived by Maximum Probability (MP) Theorem shown in the current paper. In this probabilistic framework, a model is defined as an event in the probability space, and a model or the associated event -- either the true underlying model or the parameterized model -- have a quantified probability measure. This quantification of a model's probability measure is derived by the MP Theorem, in which we have shown that an event's probability measure has an upper-bound given its conditional distribution on an arbitrary random variable. Through this alternative framework, the notion of model parameters is encompassed in the definition of the model or the associated event. Therefore, this framework deviates from the conventional approach of assuming a prior on the model parameters. Instead, the regularizing effects of assuming prior over parameters is seen through maximizing probabilities of models or according to information theory, minimizing the information content of a model. The probability of a model in our framework is invariant to reparameterization and is solely dependent on the model's likelihood function. Also, rather than maximizing the posterior in a conventional Bayesian setting, the objective function in our alternative framework is defined as the probability of set operations (e.g. intersection) on the event of the true underlying model and the event of the model at hand. Our theoretical framework, as a derivation of MP theorem, adds clarity to probabilistic learning through solidifying the definition of probabilistic models, quantifying their probabilities, and providing a visual understanding of objective functions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑