利用社交媒体的罕见事件的可预测性:机器学习视角
On predictability of rare events leveraging social media: a machine learning perspective
摘要:
从社交媒体流中提取的信息被用来预测大量现实世界事件的结果,从政治选举到股市波动。越来越多的研究表明,对社交媒体对话的分析如何提供廉价的大众智慧。然而,在何种程度和背景下可以有效地利用这种预测能力,仍然没有得到证实,至少没有得到系统的证实。目前还不清楚基于社交媒体的预测与基于其他信息源的预测相比如何。为了解决这些问题,在这里,我们开发了一个机器学习框架,利用社交媒体流来自动识别和预测足球比赛的结果。我们特别关注至少有一种可能的结果被专业博彩公司认为是极不可能的比赛。我们认为,体育赛事提供了一个系统的方法来测试社交媒体的预测能力,并允许这种力量与外部来源设定的严格基线进行比较。尽管有如此严格的基线,我们的框架在用于通知简单的投注策略时,仍能产生超过8%的边际利润。该系统基于实时情感分析,并利用在比赛前收集的数据,允许知情投注。我们讨论了我们的方法背后的基本原理,描述了学习框架,它的预测性能和它提供的回报相比,一组投注策略。为了测试我们的框架,我们使用了来自2014年FIFA世界杯比赛的历史Twitter数据,以及通过监控2014年10月25日至2014年11月26日期间欧洲四大锦标赛(英超联赛,意甲联赛,西甲联赛和德甲联赛)和2014年欧洲冠军联赛的所有足球比赛的对话收集的实时Twitter数据。
英文摘要:
Information extracted from social media streams has been leveraged to forecast the outcome of a large number of real-world events, from political elections to stock market fluctuations. An increasing amount of studies demonstrates how the analysis of social media conversations provides cheap access to the wisdom of the crowd. However, extents and contexts in which such forecasting power can be effectively leveraged are still unverified at least in a systematic way. It is also unclear how social-media-based predictions compare to those based on alternative information sources. To address these issues, here we develop a machine learning framework that leverages social media streams to automatically identify and predict the outcomes of soccer matches. We focus in particular on matches in which at least one of the possible outcomes is deemed as highly unlikely by professional bookmakers. We argue that sport events offer a systematic approach for testing the predictive power of social media, and allow to compare such power against the rigorous baselines set by external sources. Despite such strict baselines, our framework yields above 8% marginal profit when used to inform simple betting strategies. The system is based on real-time sentiment analysis and exploits data collected immediately before the games, allowing for informed bets. We discuss the rationale behind our approach, describe the learning framework, its prediction performance and the return it provides as compared to a set of betting strategies. To test our framework we use both historical Twitter data from the 2014 FIFA World Cup games, and real-time Twitter data collected by monitoring the conversations about all soccer matches of four major European tournaments (FA Premier League, Serie A, La Liga, and Bundesliga), and the 2014 UEFA Champions League, during the period between Oct. 25th 2014 and Nov. 26th 2014.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。