置信度作为预测:置信区间的一种决策理论解释
Confidence as Forecast: A Decision-Theoretic Interpretation of Confidence Intervals
AI总结:
本文从决策理论角度重新诠释置信区间,将其视为概率预测,通过严格评分规则证明置信水平为覆盖的最优预测,并探讨其在不同模型下的应用与改进。
摘要:
如果 anything,一个经验主义者应该如何谈论一个实际实现的置信区间(CI)及其覆盖参数的机会?Jerzy Neyman最初的答复是拒绝事后非退化的概率覆盖,并转而“声明该区间覆盖”。在本文中,我论证通常的经验主义机器已经支持另一种解读。我将覆盖事件视为伯努利随机变量,其名义水平1-α作为设计基础的成功概率,并将“置信度”视为该伯努利结果的概率预测。使用严格合理的评分规则,我证明1-α是覆盖的唯一最优常数预测,无论是事前还是事后观察数据,且在常见的无界、平移不变模型中,即使使用基于枢轴的置信区间,其仍保持最优。当设计产生一个无θ的统计量——例如有限窗口均匀模型中的区间相对宽度时,给定该统计量的条件覆盖提供了一个非常数、基于设计的改进,严格提高了预测性能。两个思想实验,一个蒙提霍尔式贝壳游戏和Morey等人(2016)的“失踪潜艇”例子,展示了如何通过这种视角解决关于置信区间熟悉解释性谜题,而无需依赖先验或单次案例主观信念。最后,我提供简单的“看到一个区间时该怎么办”的指导,以及关于将置信区间作为预测长期覆盖工具进行教学的一些启示。
英文摘要:
What, if anything, should a frequentist say about a single realized confidence interval (CI) and its chance of having covered the parameter? Jerzy Neyman's original answer was to refuse any nondegenerate probability for coverage ex post and, instead, to "state that the interval covers". In this paper I argue that the usual frequentist machinery already supports a different reading. I treat the coverage event as a Bernoulli random variable, with the nominal level 1-alpha as its design-based success probability, and view "confidence" as a probability forecast for that Bernoulli outcome. Using strictly proper scoring rules, I show that 1-alpha is the unique optimal constant forecast for coverage, both before and after observing the data, and that it remains optimal post-trial in common unbounded, translation-invariant models with pivot-based CIs. When the design yields a theta-free statistic--such as the relative width of the interval in a finite-window uniform model--the conditional coverage given that statistic provides a nonconstant, design-based refinement of 1-alpha that strictly improves predictive performance. Two thought experiments, a Monty Hall-style shell game and the "lost submarine" example of Morey et al. (2016), illustrate how this perspective resolves familiar interpretational puzzles about CIs without appealing to priors or single-case subjective degrees of belief. I conclude with simple "what to do when you see an interval" guidance for applied work and some implications for teaching confidence intervals as tools for forecasting long-run coverage. Keywords: Confidence intervals, coverage probability, proper scoring rules, probabilistic forecasting, frequentist inference Disclaimer: The findings and conclusions in this report are those of the author and do not necessarily represent the official position of the Centers for Disease Control and Prevention
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。