大规模跨文档共指的距离标注方法
Distantly Labeling Data for Large Scale Cross-Document Coreference
摘要:
跨文档共指,即解决多文档集合中实体提及的问题,是自动化知识库构建和数据采掘任务的关键。然而,大型标记数据集的稀缺性阻碍了针对该任务的监督机器学习研究。在本文中,我们开发和展示了一种方法的基础上“远距离标记”的数据集,我们可以训练的歧视性跨文档共指模型。特别是,我们建立了一个数据集,从3.5年的《纽约时报》文章中提取了超过100万人的提及,利用维基百科进行远距离标记,并使用生成模型(并测量这种标记的可靠性);然后我们训练并评估一个条件随机场共指模型,该模型具有跨文档实体以及提及对的因素。该共指模型在解决训练数据中不存在的提及和实体方面获得了高准确性,表明对非维基百科数据的适用性。考虑到大量的数据,我们的工作也是展示我们方法的可扩展性的练习。
英文摘要:
Cross-document coreference, the problem of resolving entity mentions across multi-document collections, is crucial to automated knowledge base construction and data mining tasks. However, the scarcity of large labeled data sets has hindered supervised machine learning research for this task. In this paper we develop and demonstrate an approach based on ``distantly-labeling'' a data set from which we can train a discriminative cross-document coreference model. In particular we build a dataset of more than a million people mentions extracted from 3.5 years of New York Times articles, leverage Wikipedia for distant labeling with a generative model (and measure the reliability of such labeling); then we train and evaluate a conditional random field coreference model that has factors on cross-document entities as well as mention-pairs. This coreference model obtains high accuracy in resolving mentions and entities that are not present in the training data, indicating applicability to non-Wikipedia data. Given the large amount of data, our work is also an exercise demonstrating the scalability of our approach.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。