arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 0906.0211cs.LG
收藏

统计学习中一种非参数化正则情形的状态方程

Equations of States in Statistical Learning for a Nonparametrizable and Regular Case

Tokyo Institute of Technology(东京工业大学)

Sumio Watanabe

摘要:

许多具有层次结构或隐变量的学习机现在被用于信息科学、人工智能和生物信息学。然而,在这些领域中使用的几个学习机是不规则的,但奇异的统计模型,因此他们的泛化性能仍然是未知的。为了克服这些问题,在以前的论文中,我们证明了统计学习中的新方程,通过该方程,我们可以在真实分布是包含在学习机中的奇异性的条件下,从贝叶斯训练损失和函数方差估计贝叶斯泛化损失。在本文中,我们证明了相同的方程成立,即使一个真正的分布是不包含在参数模型。同时证明了所提出的方程在正则情形下渐近等价于Takeuchi信息准则。因此,所提出的方程总是适用的,而不需要对未知的真实分布做任何条件。

英文摘要:

Many learning machines that have hierarchical structure or hidden variables are now being used in information science, artificial intelligence, and bioinformatics. However, several learning machines used in such fields are not regular but singular statistical models, hence their generalization performance is still left unknown. To overcome these problems, in the previous papers, we proved new equations in statistical learning, by which we can estimate the Bayes generalization loss from the Bayes training loss and the functional variance, on the condition that the true distribution is a singularity contained in a learning machine. In this paper, we prove that the same equations hold even if a true distribution is not contained in a parametric model. Also we prove that, the proposed equations in a regular case are asymptotically equivalent to the Takeuchi information criterion. Therefore, the proposed equations are always applicable without any condition on the unknown true distribution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑