arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2207.08087cs.CLcs.IR
收藏

面向实体集扩展的自动上下文模式生成

Automatic Context Pattern Generation for Entity Set Expansion

Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Peng Cheng Laboratory(鹏城实验室);School of Intelligent Systems Engineering, Sun Yat-Sen University(中山大学智能工程学院);Tencent Cloud Xiaowei(腾讯云小微);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)

Yinghui Li, Shulin Huang, Xinwei Zhang, Qingyu Zhou, Yangning Li, Ruiyang Liu, Yunbo Cao, Hai-Tao Zheng, Ying Shen

AI总结:

针对实体集扩展依赖高质量实体标注语料的问题,提出语料库无关的GAPA框架,利用GPT-2等自回归语言模型自动生成实体上下文模式并扩展目标实体。

摘要:

实体集扩展(Entity Set Expansion,ESE)是一项有价值的任务,旨在根据给定种子实体查找目标语义类别的实体。由于ESE具有知识发现能力,许多自然语言处理(NLP)和信息检索(IR)下游应用都从中受益。尽管现有的基于语料库的ESE方法已取得显著进展,但它们仍依赖带有高质量实体信息标注的语料库,因为多数方法需要通过实体在句子中的位置来获取上下文模式。因此,给定语料库及其实体标注的质量已成为限制此类方法性能的瓶颈。为克服这一困境并使ESE模型摆脱对实体标注的依赖,本文旨在探索一种新的ESE范式,即语料库无关的ESE。具体而言,我们设计了一个上下文模式生成模块,利用自回归语言模型(如GPT-2)为实体自动生成高质量的上下文模式。此外,我们提出了GAPA,这是一种利用上述生成模式(GenerAted PAtterns)扩展目标实体的新型ESE框架。在三个广泛使用的数据集上进行的大量实验和详细分析证明了本文方法的有效性。所有实验代码均可在https://github.com/geekjuruo/GAPA获取。

英文摘要:

Entity Set Expansion (ESE) is a valuable task that aims to find entities of the target semantic class described by given seed entities. Various Natural Language Processing (NLP) and Information Retrieval (IR) downstream applications have benefited from ESE due to its ability to discover knowledge. Although existing corpus-based ESE methods have achieved great progress, they still rely on corpora with high-quality entity information annotated, because most of them need to obtain the context patterns through the position of the entity in a sentence. Therefore, the quality of the given corpora and their entity annotation has become the bottleneck that limits the performance of such methods. To overcome this dilemma and make the ESE models free from the dependence on entity annotation, our work aims to explore a new ESE paradigm, namely corpus-independent ESE. Specifically, we devise a context pattern generation module that utilizes autoregressive language models (e.g., GPT-2) to automatically generate high-quality context patterns for entities. In addition, we propose the GAPA, a novel ESE framework that leverages the aforementioned GenerAted PAtterns to expand target entities. Extensive experiments and detailed analyses on three widely used datasets demonstrate the effectiveness of our method. All the codes of our experiments are available at https://github.com/geekjuruo/GAPA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑