arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1707.02048stat.AP
收藏

用极值一致损失函数检验期望值和分位数的预测精度

Testing Forecast Accuracy of Expectiles and Quantiles with the Extremal Consistent Loss Functions

Yu-Min Yen, Tso-Jung Yen

摘要:

预测评估的目的是选择一个准确的预测决策使用损失函数。然而,不同的损失函数往往会产生不同的预测排名结果,这使得比较任务变得复杂。在本文中,我们发展了统计测试比较性能的预测期望值和分位数的随机变量下一致的损失函数。检验统计量使用Ehm et.al.(2016)的极值一致性损失函数构建。测试的原假设是,在所有极值一致损失函数下,基准预测至少与竞争预测表现相同。可以证明,如果这样的空值成立,基准也将在所有一致的损失函数下至少与竞争对手表现得一样好。因此,在空值下,当使用不同的一致性损失函数时,竞争对手没有超过基准的结果不会改变。我们建立了所提出的检验统计量的渐近性质,并建议使用重中心自助法来构造它们的经验分布。通过模拟,我们表明所提出的检验统计量表现相当不错。然后,我们将所提出的方法应用于(1)重新检查一些常用的预测标准普尔500指数的风险溢价的能力;(2)比较专家对美国实际国内生产总值年增长率的预测性能;(3)评估标准普尔500指数的估计每日风险价值的性能。

英文摘要:

Forecast evaluations aim to choose an accurate forecast for making decisions by using loss functions. However, different loss functions often generate different ranking results for forecasts, which complicates the task of comparisons. In this paper, we develop statistical tests for comparing performances of forecasting expectiles and quantiles of a random variable under consistent loss functions. The test statistics are constructed with the extremal consistent loss functions of Ehm et.al. (2016). The null hypothesis of the tests is that a benchmark forecast at least performs equally well as a competing one under all extremal consistent loss functions. It can be shown that if such a null holds, the benchmark will also perform at least equally well as the competitor under all consistent loss functions. Thus under the null, when different consistent loss functions are used, the result that the competitor does not outperform the benchmark will not be altered. We establish asymptotic properties of the proposed test statistics and propose to use the re-centered bootstrap to construct their empirical distributions. Through simulations, we show the proposed test statistics perform reasonably well. We then apply the proposed method on (1) re-examining abilities of some often-used predictors on forecasting risk premium of the S&P500 index; (2) comparing performances of experts' forecasts on annual growth of U.S. real gross domestic product; (3) evaluating performances of estimated daily value at risk of the S&P500 index.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑