arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2111.03153cs.GTcs.LG
收藏

你比随机专家更聪明吗?可替换信号的鲁棒集结

Are You Smarter Than a Random Expert? The Robust Aggregation of Substitutable Signals

Eric Neyman, Tim Roughgarden

摘要:

汇总专家预测的问题在机器学习、经济学、气候科学和国家安全等广泛领域中无处不在。尽管如此,我们对这个问题的理论认识还是比较肤浅的。本文提出了一种从广泛的信息结构中选择专家知识的预测聚合方法。虽然在充分的一般性,它是不可能实现一个非平凡的性能保证,我们表明,这样做是可能的条件下的专家的信息结构,我们称之为\emph{projective substitutes}。投射替代条件是信息替代的概念:学习专家信号的边际收益递减。我们发现,在投影替代条件下,采取平均的专家的预测大大提高了信任一个随机的专家的策略。然后,我们考虑一个更宽松的设置,其中聚合器可以访问先验。我们表明,通过平均的专家的预测,然后\emph{extremizing}的平均值,通过移动它远离由一个常数因子的先验,聚合器的性能保证是大大优于可能没有知识的先验。我们的研究结果为过去的实证研究提供了理论依据,并有助于指导适当的极值。

英文摘要:

The problem of aggregating expert forecasts is ubiquitous in fields as wide-ranging as machine learning, economics, climate science, and national security. Despite this, our theoretical understanding of this question is fairly shallow. This paper initiates the study of forecast aggregation in a context where experts' knowledge is chosen adversarially from a broad class of information structures. While in full generality it is impossible to achieve a nontrivial performance guarantee, we show that doing so is possible under a condition on the experts' information structure that we call \emph{projective substitutes}. The projective substitutes condition is a notion of informational substitutes: that there are diminishing marginal returns to learning the experts' signals. We show that under the projective substitutes condition, taking the average of the experts' forecasts improves substantially upon the strategy of trusting a random expert. We then consider a more permissive setting, in which the aggregator has access to the prior. We show that by averaging the experts' forecasts and then \emph{extremizing} the average by moving it away from the prior by a constant factor, the aggregator's performance guarantee is substantially better than is possible without knowledge of the prior. Our results give a theoretical grounding to past empirical research on extremization and help give guidance on the appropriate amount to extremize.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑