arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.13897cs.CL
收藏

通过语言模型探测增强实体集扩展

Empower Entity Set Expansion via Language Model Probing

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of California San Diego(加利福尼亚大学圣地亚哥分校)

Yunyi Zhang, Jiaming Shen, Jingbo Shang, Jiawei Han

摘要:

实体集扩展是一项重要的任务,它的目标是用属于同一语义类的新实体来扩展一个小的种子实体集,这有利于许多下游的自然语言处理和信息检索应用,如问答、查询理解和分类构造。现有的集合扩展方法通过自适应地选择上下文特征和提取新的实体来引导种子实体集合。实体集扩展的一个关键挑战是避免选择模糊的上下文特征,这将改变类的语义,并导致在以后的迭代中累积错误。在这项研究中,我们提出了一种新的迭代集扩展框架,利用自动生成的类名来解决语义漂移问题。在每次迭代中,我们通过探测预先训练的语言模型来选择一个正类名和几个负类名,并根据所选类名对每个候选实体进行进一步评分。在两个数据集上的实验表明,我们的框架生成高质量的类名,并显着优于以前的最先进的方法。

英文摘要:

Entity set expansion, aiming at expanding a small seed entity set with new entities belonging to the same semantic class, is a critical task that benefits many downstream NLP and IR applications, such as question answering, query understanding, and taxonomy construction. Existing set expansion methods bootstrap the seed entity set by adaptively selecting context features and extracting new entities. A key challenge for entity set expansion is to avoid selecting ambiguous context features which will shift the class semantics and lead to accumulative errors in later iterations. In this study, we propose a novel iterative set expansion framework that leverages automatically generated class names to address the semantic drift issue. In each iteration, we select one positive and several negative class names by probing a pre-trained language model, and further score each candidate entity based on selected class names. Experiments on two datasets show that our framework generates high-quality class names and outperforms previous state-of-the-art methods significantly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑