arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1206.6814cs.AIcs.LG
收藏

专家预测集结算法的实证比较

An Empirical Comparison of Algorithms for Aggregating Expert Predictions

University of Chicago(芝加哥大学);Yahoo! Research Labs(雅虎研究院);University of Washington(华盛顿大学)

Varsha Dani, Omid Madani, David M Pennock, Sumit Sanghai, Brian Galebach

摘要:

预测未来事件的结果是一个具有挑战性的问题,已经探索和尝试了各种解决方法。我们提出了一个经验比较的各种在线和离线自适应算法,用于汇总专家的预测结果的五年的美国国家足球联赛的比赛(1319场比赛),使用专家概率启发从互联网竞赛称为ProbabilitySports。我们发现,这是很难提高简单的平均预测的预测精度方面,但有改进的空间,在二次损失。有点令人惊讶的是,在我们的算法集合中,估计每个专家预测方差的贝叶斯估计算法比简单平均表现出最一致的优越性能。

英文摘要:

Predicting the outcomes of future events is a challenging problem for which a variety of solution methods have been explored and attempted. We present an empirical comparison of a variety of online and offline adaptive algorithms for aggregating experts' predictions of the outcomes of five years of US National Football League games (1319 games) using expert probability elicitations obtained from an Internet contest called ProbabilitySports. We find that it is difficult to improve over simple averaging of the predictions in terms of prediction accuracy, but that there is room for improvement in quadratic loss. Somewhat surprisingly, a Bayesian estimation algorithm which estimates the variance of each expert's prediction exhibits the most consistent superior performance over simple averaging among our collection of algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑