利用社会话语衡量声明的事实核查价值
Leveraging Social Discourse to Measure Check-worthiness of Claims for Fact-checking
AI总结：
本文提出细粒度声明核查价值新任务及CheckIt数据集，并设计统一方法CheckMate联合判断声明是否值得核查及其原因，实验验证了整合核查价值因素的有效性。
摘要：
在线社交媒体平台的扩张导致了在线内容消费的激增。然而，这也为传播虚假声明和错误信息铺平了道路。因此，对大量人力来筛选和验证这些未经核实的声明的需求日益增长。目前，这些声明由事实核查人员手动核实。然而，在线内容的数量往往超过了他们的处理能力，使得他们难以以及时的方式验证每一条声明。因此，确定哪些断言值得进行事实核查，并优先处理需要立即关注的声明至关重要。多种因素共同决定了一条声明是否需要事实核查，包括其事实正确性、对公众的潜在影响、煽动仇恨的可能性等等。尽管已有若干工作致力于解决声明核查价值问题，但识别这些因素的系统性方法仍然是一个开放的挑战。为此，我们引入了一项细粒度声明核查价值的新任务，该任务涵盖了所有这些因素，并为将一条声明识别为具有核查价值提供了可能的人类依据。我们提出了CheckIt，一个用于细粒度声明核查价值的人工标注大型Twitter数据集。我们使用一个统一的CheckMate方法对我们的数据集进行基准测试，该方法联合判断一条声明是否具有核查价值以及导致该结论的因素。我们将所提出的系统与多个基线系统进行了比较。最后，我们报告了对结果和人工评估的全面分析，验证了在检测值得事实核查的声明中整合核查价值因素的有效性。
英文摘要：
The expansion of online social media platforms has led to a surge in online content consumption. However, this has also paved the way for disseminating false claims and misinformation. As a result, there is an escalating demand for a substantial workforce to sift through and validate such unverified claims. Currently, these claims are manually verified by fact-checkers. Still, the volume of online content often outweighs their potency, making it difficult for them to validate every single claim in a timely manner. Thus, it is critical to determine which assertions are worth fact-checking and prioritize claims that require immediate attention. Multiple factors contribute to determining whether a claim necessitates fact-checking, encompassing factors such as its factual correctness, potential impact on the public, the probability of inciting hatred, and more. Despite several efforts to address claim check-worthiness, a systematic approach to identify these factors remains an open challenge. To this end, we introduce a new task of fine-grained claim check-worthiness, which underpins all of these factors and provides probable human grounds for identifying a claim as check-worthy. We present CheckIt, a manually annotated large Twitter dataset for fine-grained claim check-worthiness. We benchmark our dataset against a unified approach, CheckMate, that jointly determines whether a claim is check-worthy and the factors that led to that conclusion. We compare our suggested system with several baseline systems. Finally, we report a thorough analysis of results and human assessment, validating the efficacy of integrating check-worthiness factors in detecting claims worth fact-checking.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
