从文本测量预测技能
Measuring Forecasting Skill from Text
摘要:
人们对未来做出准确预测的能力各不相同。先前的研究表明,有些人可以预测未来事件的结果,并且准确性始终更高。这就引出了一个自然的问题:是什么让一些预测者比其他人更好?在本文中,我们探讨了人们用来描述他们的预测和他们的预测技能之间的联系。研究了来自两个不同预测领域的数据集:(1)来自在线预测论坛Good Judgment Open的地缘政治预测;(2)由金融分析师进行的公司盈利预测语料库。我们提出了一些语言的度量,这些度量是在与人们对未来的预测相关的文本上计算的,包括:不确定性,可读性和情感。通过研究与预测相关的语言因素,我们能够对熟练的预测者所采取的方法有所了解。此外,我们证明了使用仅基于语言的模型来准确预测预测技能是可能的。这可能有助于更早地识别准确的预测或潜在的熟练预测人员。
英文摘要:
People vary in their ability to make accurate predictions about the future. Prior studies have shown that some individuals can predict the outcome of future events with consistently better accuracy. This leads to a natural question: what makes some forecasters better than others? In this paper we explore connections between the language people use to describe their predictions and their forecasting skill. Datasets from two different forecasting domains are explored: (1) geopolitical forecasts from Good Judgment Open, an online prediction forum and (2) a corpus of company earnings forecasts made by financial analysts. We present a number of linguistic metrics which are computed over text associated with people's predictions about the future including: uncertainty, readability, and emotion. By studying linguistic factors associated with predictions, we are able to shed some light on the approach taken by skilled forecasters. Furthermore, we demonstrate that it is possible to accurately predict forecasting skill using a model that is based solely on language. This could potentially be useful for identifying accurate predictions or potentially skilled forecasters earlier.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。