arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.10935cs.HCcs.AI
收藏

人们想要验证什么?

What do people want to fact-check?

University of Southern California(南加州大学);Mila;Université de Montréal(蒙特利尔大学);McGill University(麦吉尔大学)

Bijean Ghafouri, Dorsaf Sallami, Luca Luceri, Taylor Lynn Curtis, Jean-Francois Godbout, Emilio Ferrara, Reihaneh Rabbany

AI总结:

研究发现人们在验证请求中倾向于简单描述性声明,且存在无法实证解决的请求,揭示了现有验证工具与真实需求的不匹配。

摘要:

关于虚假信息的研究几乎只关注供应端,询问哪些谎言传播、谁生产它们以及纠正是否有效。一个基本的需求端问题仍未得到回答。当普通人可以验证他们想要的任何内容时,他们实际上会问什么?我们通过分析近2500条由457名参与者提交给一个开放式AI验证系统中的陈述,提供了对此问题的第一个大规模证据。每条声明都被分类到五个语义维度(领域、认知形式、可验证性、目标实体和时间参考),产生了一张公众验证需求的行为地图。三个发现尤为突出。第一,用户在主题上范围广泛,但默认选择狭窄的认知 repertoire,普遍提交关于现时可观察的简单描述性声明。第二,大约四分之一的请求涉及无法通过实证解决的陈述,包括道德判断、推测性预测和主观评价,揭示了用户对验证工具的需求与这些工具能提供的内容之间存在系统性不匹配。第三,与FEVER基准数据集的比较揭示了所有五个维度上的显著结构性差异,表明标准评估语料库编码了一个合成的声明环境,与现实世界的验证需求不相符。这些结果将验证重新定义为需求驱动的问题,并指出现有AI系统和基准与人们实际经历的不确定性之间的不匹配。

英文摘要:

Research on misinformation has focused almost exclusively on supply, asking what falsehoods circulate, who produces them, and whether corrections work. A basic demand-side question remains unanswered. When ordinary people can fact-check anything they want, what do they actually ask about? We provide the first large-scale evidence on this question by analyzing close to 2{,}500 statements submitted by 457 participants to an open-ended AI fact-checking system. Each claim is classified along five semantic dimensions (domain, epistemic form, verifiability, target entity, and temporal reference), producing a behavioral map of public verification demand. Three findings stand out. First, users range widely across topics but default to a narrow epistemic repertoire, overwhelmingly submitting simple descriptive claims about present-day observables. Second, roughly one in four requests concerns statements that cannot be empirically resolved, including moral judgments, speculative predictions, and subjective evaluations, revealing a systematic mismatch between what users seek from fact-checking tools and what such tools can deliver. Third, comparison with the FEVER benchmark dataset exposes sharp structural divergences across all five dimensions, indicating that standard evaluation corpora encode a synthetic claim environment that does not resemble real-world verification needs. These results reframe fact-checking as a demand-driven problem and identify where current AI systems and benchmarks are misaligned with the uncertainty people actually experience.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑