arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.04879stat.AP
收藏

预测竞赛的未来:设计属性和原则

The future of forecasting competitions: Design attributes and principles

Spyros Makridakis, Chris Fry, Fotios Petropoulos, Evangelos Spiliotis

摘要:

预测竞赛相当于物理和生命科学中广泛使用的实验室实验。它们提供有用的客观信息,以改进预测的理论和实践,推进该领域的发展,扩大其使用范围,并提高其对决策者的价值。我们描述了10个设计属性时要考虑组织预测比赛,考虑到最佳选择和实际问题,如成本之间的权衡,以及参与其中所需的时间和精力。因此,我们绘制了所有主要的过去的比赛在其设计属性,确定它们之间的相似性和差异,以及设计差距,并提出建议的原则,将包括在未来的比赛,特别强调学习尽可能多地从他们的实施,以帮助提高预测的准确性和不确定性。我们讨论的预测任务往往提出了许多挑战,可以很难被捕获在一个单一的预测比赛。因此,为了评估预测员的素质,我们建议未来比赛的组织者考虑多竞赛的方法。我们提出了一个预测的想法“athlon”,在不同的特点不同的挑战发生。

英文摘要:

Forecasting competitions are the equivalent of laboratory experimentation widely used in physical and life sciences. They provide useful, objective information to improve the theory and practice of forecasting, advancing the field, expanding its usage and enhancing its value to decision and policymakers. We describe ten design attributes to be considered when organizing forecasting competitions, taking into account trade-offs between optimal choices and practical concerns like costs, as well as the time and effort required to participate in them. Consequently, we map all major past competitions in respect to their design attributes, identifying similarities and differences between them, as well as design gaps, and making suggestions about the principles to be included in future competitions, putting a particular emphasis on learning as much as possible from their implementation in order to help improve forecasting accuracy and uncertainty. We discuss that the task of forecasting often presents a multitude of challenges that can be difficult to be captured in a single forecasting contest. To assess the caliber of a forecaster, we, therefore, propose that organizers of future competitions consider a multi-contest approach. We suggest the idea of a forecasting "athlon", where different challenges of varying characteristics take place.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑