arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1706.08186cs.CL
收藏

基于知识库的同义词自动发现

Automatic Synonym Discovery with Knowledge Bases

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Meng Qu, Xiang Ren, Jiawei Han

摘要:

从文本中识别实体同义词已成为许多实体利用应用程序中的关键任务。然而,从域特定文本语料库(例如,新闻文章,科学论文)是相当具有挑战性的。当前的系统将实体名称串作为输入以找出同义的其他名称,忽略了名称串经常可以指代多个实体(例如,“苹果”可以指苹果公司和水果苹果)。此外,大多数现有的方法需要由领域专家手动创建的训练数据来构建监督学习系统。本文研究了基于知识库的同义词自动发现问题,即在特定领域的语料库中为知识库实体识别同义词。存储在知识库中的每个实体的手动策划的同义词不仅形成一组名称字符串以消除彼此的含义,而且还可以作为“远程”监督以帮助确定任务的重要特征。我们提出了一个新的框架,称为DPE,整合两种相互补充的信号进行同义词发现,即,基于语料库统计的分布特征和基于局部上下文的文本模式。特别是,DPE结合远程监督对两种信号进行联合优化,使它们在训练阶段相互增强。在推理阶段,两个信号都将被用来发现给定实体的同义词。实验结果证明了该框架的有效性。

英文摘要:

Recognizing entity synonyms from text has become a crucial task in many entity-leveraging applications. However, discovering entity synonyms from domain-specific text corpora (e.g., news articles, scientific papers) is rather challenging. Current systems take an entity name string as input to find out other names that are synonymous, ignoring the fact that often times a name string can refer to multiple entities (e.g., "apple" could refer to both Apple Inc and the fruit apple). Moreover, most existing methods require training data manually created by domain experts to construct supervised-learning systems. In this paper, we study the problem of automatic synonym discovery with knowledge bases, that is, identifying synonyms for knowledge base entities in a given domain-specific corpus. The manually-curated synonyms for each entity stored in a knowledge base not only form a set of name strings to disambiguate the meaning for each other, but also can serve as "distant" supervision to help determine important features for the task. We propose a novel framework, called DPE, to integrate two kinds of mutually-complementing signals for synonym discovery, i.e., distributional features based on corpus-level statistics and textual patterns based on local contexts. In particular, DPE jointly optimizes the two kinds of signals in conjunction with distant supervision, so that they can mutually enhance each other in the training stage. At the inference stage, both signals will be utilized to discover synonyms for the given entities. Experimental results prove the effectiveness of the proposed framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑