arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.21229q-fin.GNcs.CLcs.LG
收藏

预测未来语言:提及市场中的上下文设计

Forecasting Future Language: Context Design for Mention Markets

LinqAlpha;Massachusetts Institute of Technology(麻省理工学院);Kalshi;IBM;LG AI Research(LG AI研究);University of Florida(佛罗里达大学);Seoul National University(首尔国立大学);Pusan National University(釜山国立大学);University of California, Berkeley(加州大学伯克利分校);UNIST(全南国立大学)

Sumin Kim, Jihoon Kwon, Yoon Kim, Nicole Kagan, Raffi Khatchadourian, Wonbin Ahn, Alejandro Lopez-Lira, Jaewon Lee, Yoontae Hwang, Oscar Levy, Yongjae Lee, Chanyeol Choi

AI总结:

本文研究了提及市场中上下文设计对预测准确性的影响,提出市场条件提示(MCP)方法,通过结合市场概率和文本证据提升预测鲁棒性。

摘要:

提及市场是一种预测市场,其合同根据未来公开事件中是否提及指定关键词而确定。尽管近期研究表明大型语言模型(LLMs)可以生成与人类预测者相当的预测,但仍然不清楚输入上下文应该如何设计以支持准确预测。在本文中,我们通过在业绩电话会议提及市场上的实验研究这一问题。这些市场需要预测公司是否会在其即将举行的电话会议中提及指定的关键词。我们进行了受控比较,变化(i)提供的上下文信息(新闻和/或之前的业绩电话会议 transcript)以及(ii)如何使用市场概率(即预测市场合同价格)。我们引入了市场条件提示(MCP),它明确将市场隐含的概率视为先验,并指示 LLM 使用文本证据更新此先验,而不是重新预测基础率。在我们的实验中,我们发现了三个见解:(1)更丰富的上下文一致地提高了预测性能;(2)将市场概率视为先验并使用文本证据更新的市场条件提示(MCP)产生了更校准的预测;(3)市场概率和 MCP 的混合(MixMCP)优于市场基准。通过用市场先验抑制 LLM 的后验更新,MixMCP 产生的预测比市场或 LLM 单独使用更稳健。

英文摘要:

Mention markets, a type of prediction market in which contracts resolve based on whether a specified keyword is mentioned during a future public event, require accurate probabilistic forecasts of keyword-mention outcomes. While recent work shows that large language models (LLMs) can generate forecasts competitive with human forecasters, it remains unclear how input context should be designed to support accurate prediction. In this paper, we study this question through experiments on earnings-call mention markets, which require forecasting whether a company will mention a specified keyword during its upcoming call. We run controlled comparisons varying (i) which contextual information is provided (news and/or prior earnings-call transcripts) and (ii) how \textit{market probability}, (i.e., prediction market contract price) is used. We introduce Market-Conditioned Prompting (MCP), which explicitly treats the market-implied probability as a prior and instructs the LLM to update this prior using textual evidence, rather than re-predicting the base rate from scratch. In our experiments, we find three insights: (1) richer context consistently improves forecasting performance; (2) market-conditioned prompting (MCP), which treats the market probability as a prior and updates it using textual evidence, yields better-calibrated forecasts; and (3) a mixture of the market probability and MCP (MixMCP) outperforms the market baseline. By dampening the LLM's posterior update with the market prior, MixMCP yields more robust predictions than either the market or the LLM alone.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑