通过自动搜索语义相似的文章来支持新闻文章的验证
Supporting verification of news articles with automated search for semantically similar articles
摘要:
虚假信息是21世纪社会的主要威胁之一。由于每天都有大量的假新闻发布,识别错误信息已成为一个关键挑战。然而,没有建立解决假新闻社论的动态和多功能性的方法。我们提出了一种证据检索方法来处理假新闻,而不是对内容进行分类。学习任务被公式化为无监督的机器学习问题。为了验证的目的,我们提供给用户一组新闻文章从可靠的新闻来源支持的假设的新闻文章在查询和最终的决定是留给用户。从技术上讲,我们提出了一个两步的过程:(i)聚合步骤:从给定的文本中提取的信息,我们从可靠的新闻来源查询类似的内容。(ii)细化步骤:我们通过测量文本与步骤(i)中的集合的语义距离来缩小支持证据。距离是基于Word2Vec和Word Mover的距离计算的。在我们的实验中,只有低于一定距离阈值的内容才被视为支持证据。我们发现,我们的方法是不可知的概念漂移,即机器学习任务是独立的假设在一个文本。这使得它在假新闻和经典新闻一样多样化的时代具有很强的适应性。我们的管道为未来的进一步分析提供了可能性,例如调查新闻报道中的偏见和差异。
英文摘要:
Fake information poses one of the major threats for society in the 21st century. Identifying misinformation has become a key challenge due to the amount of fake news that is published daily. Yet, no approach is established that addresses the dynamics and versatility of fake news editorials. Instead of classifying content, we propose an evidence retrieval approach to handle fake news. The learning task is formulated as an unsupervised machine learning problem. For validation purpose, we provide the user with a set of news articles from reliable news sources supporting the hypothesis of the news article in query and the final decision is left to the user. Technically we propose a two-step process: (i) Aggregation-step: With information extracted from the given text we query for similar content from reliable news sources. (ii) Refining-step: We narrow the supporting evidence down by measuring the semantic distance of the text with the collection from step (i). The distance is calculated based on Word2Vec and the Word Mover's Distance. In our experiments, only content that is below a certain distance threshold is considered as supporting evidence. We find that our approach is agnostic to concept drifts, i.e. the machine learning task is independent of the hypotheses in a text. This makes it highly adaptable in times where fake news is as diverse as classical news is. Our pipeline offers the possibility for further analysis in the future, such as investigating bias and differences in news reporting.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。