关于统计流形的极小极大遗憾:曲率的作用
On the minmax regret for statistical manifolds: the role of curvature
摘要:
模型的复杂性在其选择中起着至关重要的作用,即通过选择适合数据并且简洁的模型。两部分代码和最小描述长度已经成功地提供了挑选最佳模型的程序,避免了过拟合。在这项工作中,我们追求这种方法,并通过在参数空间中执行进一步的假设来补充它。具体地说,我们假设参数空间是一个光滑流形,利用黎曼几何的工具,我们得到了一个比标准的随机复杂性更清晰的表达式,其中Fisher信息度量的数量曲率起着主导作用.此外,我们推导出一般统计流形的最小最大遗憾,并应用我们的结果,以获得最佳降维的背景下,主成分分析。
英文摘要:
Model complexity plays an essential role in its selection, namely, by choosing a model that fits the data and is also succinct. Two-part codes and the minimum description length have been successful in delivering procedures to single out the best models, avoiding overfitting. In this work, we pursue this approach and complement it by performing further assumptions in the parameter space. Concretely, we assume that the parameter space is a smooth manifold, and by using tools of Riemannian geometry, we derive a sharper expression than the standard one given by the stochastic complexity, where the scalar curvature of the Fisher information metric plays a dominant role. Furthermore, we derive the minmax regret for general statistical manifolds and apply our results to derive optimal dimensional reduction in the context of principal component analysis.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。