arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1410.8249stat.ME
收藏

集合预报的无知值评价--有限集合偏差的修正

Evaluating ensemble forecasts by the Ignorance score -- Correcting the finite-ensemble bias

Stefan Siegert, Christopher A. T. Ferro, David B. Stephenson

摘要:

本研究考虑了无知分数(也称为对数分数)在集成验证的背景下的应用。特别是,我们考虑的情况下,集合预测转换为正态预测分布,这个分布是由无知分数评估。结果表明,标准的无知分数是有偏见的合奏大小,使较大的合奏系统产生更好的预期成绩。一个新的估计的无知得分推导出这是无偏的相对于合奏大小。在季节性气候预测的应用程序中,它表明,标准的无知分数分配更好的预期分数简单的气候合奏或有偏见的合奏,有许多成员,比物理动态和无偏见的合奏较少的成员。相比之下,新的偏差校正的无知分数排名的物理动力学和无偏见的合奏比气候和偏见的,独立的合奏大小。结果表明,该无偏估计量比标准估计量具有更小的估计方差和误差,是一个公平的验证分数,如果集合成员与观测值在统计上一致,则该分数是最优的。更广泛地讨论了集成验证分数的有限集成偏差。有人认为,偏差校正是适当的预测系统与不同的合奏大小进行比较时,当一个潜在的合奏分布的评估是感兴趣的,可能的应用程序无偏参数估计进行了讨论。

英文摘要:

This study considers the application of the Ignorance Score (also known as the Logarithmic Score) in the context of ensemble verification. In particular, we consider the case where an ensemble forecast is transformed to a Normal forecast distribution, and this distribution is evaluated by the Ignorance Score. It is shown that the standard Ignorance score is biased with respect to the ensemble size, such that larger ensembles yield systematically better expected scores. A new estimator of the Ignorance score is derived which is unbiased with respect to the ensemble size. In an application to seasonal climate predictions it is shown that the standard Ignorance score assigns better expected scores to simple climatological ensembles or biased ensembles that have many members, than to physical dynamical and unbiased ensembles with fewer members. By contrast, the new bias-corrected Ignorance score ranks the physical dynamical and unbiased ensembles better than the climatological and biased ones, independent of ensemble size. It is shown that the unbiased estimator has smaller estimator variance and error than the standard estimator, and that it is a fair verification score, which is optimized if the ensemble members are statistically consistent with the observations. The finite ensemble bias of ensemble verification scores is discussed more broadly. It is argued that a bias-correction is appropriate when forecast systems with different ensemble sizes are compared, and when an evaluation of the underlying distribution of the ensemble is of interest; possible applications to unbiased parameter estimation are discussed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑