arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.14860math.STstat.MEstat.TH
收藏

典型性原理及其对统计学和数据科学的影响

The typicality principle and its implications for statistics and data science

Yiran Jiang, Zeyu Zhang, Ryan Martin, Chuanhai Liu

AI总结:

本文提出典型性原理,通过基于拟合优度检验的正则化策略改进参数估计,在最大似然失效的案例中展现有效性,并融入不确定性量化框架。

摘要:

数据科学的一个核心焦点是将经验证据转化为知识。因此,像费希尔、波普尔和图基这样的深刻思想家的关键见解和科学态度,预计将在未来几年激发机器学习和人工智能领域令人兴奋的新进展。沿着这些思路,本文提出了一种新颖的“典型性原理”,该原理大致表述为:如果观测到的数据相对于所提出的理论在某种意义上是足够“非典型”的,那么该理论就是没有根据的。这种对典型性的强调将诸如模型检验等熟悉但常被忽视的背景概念带到了推断的前台。典型性原理的一个实例是在参数估计的背景下,我们提出了一种新的基于典型性的正则化策略,该策略在很大程度上依赖于拟合优度检验。这种新的正则化策略的有效性在三个普通最大似然估计严重失效的非平凡例子中得到了说明。我们还展示了典型性原理如何适应于可靠且高效的不确定性量化的更大图景中。

英文摘要:

A central focus of data science is the transformation of empirical evidence into knowledge. As such, the key insights and scientific attitudes of deep thinkers like Fisher, Popper, and Tukey are expected to inspire exciting new advances in machine learning and artificial intelligence in years to come. Along these lines, the present paper advances a novel {\em typicality principle} which states, roughly, that if the observed data is sufficiently ``atypical'' in a certain sense relative to a posited theory, then that theory is unwarranted. This emphasis on typicality brings familiar but often overlooked background notions like model-checking to the inferential foreground. One instantiation of the typicality principle is in the context of parameter estimation, where we propose a new typicality-based regularization strategy that leans heavily on goodness-of-fit testing. The effectiveness of this new regularization strategy is illustrated in three non-trivial examples where ordinary maximum likelihood estimation fails miserably. We also demonstrate how the typicality principle fits within a bigger picture of reliable and efficient uncertainty quantification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑