基于知识的信任:Web资源的可信度评估
Knowledge-Based Trust: Estimating the Trustworthiness of Web Sources
摘要:
传统上,Web资源的质量是使用外部信号(如图的超链接结构)进行评估的。我们提出了一种新的方法,依赖于内源性信号,即由源提供的事实信息的正确性。几乎没有虚假事实的来源被认为是可信的。通过通常用于构建知识库的信息抽取方法从每个源自动抽取事实。我们提出了一种方法来区分错误的提取过程中的实际错误的Web源本身,通过使用联合推理在一个新的多层概率模型。我们将计算出的可信度得分称为基于知识的信任(KBT)。在合成数据上,我们证明了我们的方法可以可靠地计算源的真实可信度。然后,我们将其应用于从网络中提取的28亿事实的数据库,从而估计1.19亿网页的可信度。对结果子集的手动评估证实了该方法的有效性。
英文摘要:
The quality of web sources has been traditionally evaluated using exogenous signals such as the hyperlink structure of the graph. We propose a new approach that relies on endogenous signals, namely, the correctness of factual information provided by the source. A source that has few false facts is considered to be trustworthy. The facts are automatically extracted from each source by information extraction methods commonly used to construct knowledge bases. We propose a way to distinguish errors made in the extraction process from factual errors in the web source per se, by using joint inference in a novel multi-layer probabilistic model. We call the trustworthiness score we computed Knowledge-Based Trust (KBT). On synthetic data, we show that our method can reliably compute the true trustworthiness levels of the sources. We then apply it to a database of 2.8B facts extracted from the web, and thereby estimate the trustworthiness of 119M webpages. Manual evaluation of a subset of the results confirms the effectiveness of the method.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。