Calibeating:在自身游戏中击败预测者
"Calibeating": Beating Forecasters at Their Own Game
AI总结:
本文提出通过改进校准而不损失专业性的方法,实现预测者之间的竞争,探讨校准与专业性的平衡问题。
摘要:
为识别专业性,预测者不应仅通过校准分数来测试,因为该分数总可以被任意减小,而应通过Brier分数来评估。Brier分数是校准分数与细化分数之和;后者衡量将预测分配到相同预测的组中的质量,从而证明
英文摘要:
In order to identify expertise, forecasters should not be tested by their calibration score, which can always be made arbitrarily small, but rather by their Brier score. The Brier score is the sum of the calibration score and the refinement score; the latter measures how good the sorting into bins with the same forecast is, and thus attests to "expertise." This raises the question of whether one can gain calibration without losing expertise, which we refer to as "calibeating." We provide an easy way to calibeat any forecast, by a deterministic online procedure. We moreover show that calibeating can be achieved by a stochastic procedure that is itself calibrated, and then extend the results to simultaneously calibeating multiple procedures, and to deterministic procedures that are continuously calibrated.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。