事实核查工具有用吗?Google Fact Check 可用性探索
Are Fact-Checking Tools Helpful? An Exploration of the Usability of Google Fact Check
AI总结:
本研究评估了 Google Fact Check 在检索 COVID-19 相关虚假声明核查结果方面的性能,发现其覆盖率有限但结果可靠,并建议用户微调措辞以优化检索效果。
摘要:
专门用于事实核查的搜索工具(如 Google Fact Check)是打击社交媒体上错误信息的一种有前景的方法,尤其是在具有重大社会影响的事件期间,例如 COVID-19 大流行和美国总统选举。然而,此类方法的可用性尚未得到深入研究。我们通过分析针对 1,000 条与 COVID-19 相关的虚假声明的检索事实核查结果,评估了 Google Fact Check 的性能,发现它能够检索到 15.8% 的输入声明的核查结果,且呈现的结果相对可靠。我们还发现,获得不同核查裁决(即“虚假”、“部分虚假”、“真实”和“不可评级”)的虚假声明往往反映出多样的情感基调,且事实核查来源倾向于以不同长度和不同程度地使用词典词汇来核查声明。针对同一问题但描述不同的声明变体可能检索到不同的事实核查结果。我们建议,检索到的事实核查结果数量可以优化,且略微调整输入措辞可能是用户检索到更多有用信息的最佳实践。本研究旨在促进对最先进的事实核查工具和信息完整性的理解。
英文摘要:
Fact-checking-specific search tools such as Google Fact Check are a promising way to combat misinformation on social media, especially during events bringing significant social influence, such as the COVID-19 pandemic and the U.S. presidential elections. However, the usability of such an approach has not been thoroughly studied. We evaluated the performance of Google Fact Check by analyzing the retrieved fact-checking results regarding 1,000 COVID-19-related false claims and found it able to retrieve the fact-checking results for 15.8% of the input claims, and the rendered results are relatively reliable. We also found that the false claims receiving different fact-checking verdicts (i.e., "False," "Partly False," "True," and "Unratable") tend to reflect diverse emotional tones, and fact-checking sources tend to check the claims in different lengths and using dictionary words to various extents. Claim variations addressing the same issue yet described differently are likely to retrieve distinct fact-checking results. We suggest that the quantities of the retrieved fact-checking results could be optimized and that slightly adjusting input wording may be the best practice for users to retrieve more useful information. This study aims to contribute to the understanding of state-of-the-art fact-checking tools and information integrity.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。