arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.02500cs.CL
收藏

TempEL:链接动态发展和新兴实体

TempEL: Linking Dynamically Evolving and Newly Emerging Entities

Ghent University – imec(根特大学-imec微电子研究中心);University of Copenhagen(哥本哈根大学)

Klim Zaporojets, Lucie-Aimee Kaffee, Johannes Deleu, Thomas Demeester, Chris Develder, Isabelle Augenstein

摘要:

在我们不断发展的世界中,实体随着时间的推移而变化,新的,以前不存在或未知的实体出现。我们研究这种进化的情况下如何影响一个完善的实体链接(EL)任务的性能。在这项研究中,我们引入了TempEL,这是一个实体链接数据集,由2013年至2022年的时间分层英文维基百科快照组成,从中我们收集了实体的锚点提及和这些目标实体的描述。通过捕获这样的时间方面,我们新引入的TempEL资源与当前现有的实体链接数据集形成对比,实体链接数据集由链接到目标知识库的单个静态版本的固定提及组成(例如,Wikipedia 2010 for CoNLL-AIDA)。事实上,对于我们收集的每个时间快照,TempEL包含到连续实体的链接,即,在所有的年份中发生,以及在某个时候首次出现的全新实体。因此,我们能够量化当前最先进的EL模型的性能,用于:(i)在其知识库描述以及其提及的上下文中随时间变化的实体,以及(ii)先前不存在的新创建的实体(例如,在EL模型被训练的时候)。我们的实验结果表明,在时间性能下降方面,(i)连续实体遭受高达3.1%的EL准确性下降,而(ii)对于新实体,这种准确性下降高达17.9%。这突出了所引入的TempEL数据集的挑战,并在时间演化实体消歧领域开辟了新的研究前景。

英文摘要:

In our continuously evolving world, entities change over time and new, previously non-existing or unknown, entities appear. We study how this evolutionary scenario impacts the performance on a well established entity linking (EL) task. For that study, we introduce TempEL, an entity linking dataset that consists of time-stratified English Wikipedia snapshots from 2013 to 2022, from which we collect both anchor mentions of entities, and these target entities' descriptions. By capturing such temporal aspects, our newly introduced TempEL resource contrasts with currently existing entity linking datasets, which are composed of fixed mentions linked to a single static version of a target Knowledge Base (e.g., Wikipedia 2010 for CoNLL-AIDA). Indeed, for each of our collected temporal snapshots, TempEL contains links to entities that are continual, i.e., occur in all of the years, as well as completely new entities that appear for the first time at some point. Thus, we enable to quantify the performance of current state-of-the-art EL models for: (i) entities that are subject to changes over time in their Knowledge Base descriptions as well as their mentions' contexts, and (ii) newly created entities that were previously non-existing (e.g., at the time the EL model was trained). Our experimental results show that in terms of temporal performance degradation, (i) continual entities suffer a decrease of up to 3.1% EL accuracy, while (ii) for new entities this accuracy drop is up to 17.9%. This highlights the challenge of the introduced TempEL dataset and opens new research prospects in the area of time-evolving entity disambiguation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑