arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1806.04411cs.IR
收藏

极有限数据下的命名实体识别

Named Entity Recognition with Extremely Limited Data

John Foley, Sheikh Muhammad Sarwar, James Allan

摘要:

传统的信息检索将命名实体识别视为索引前的语料标注任务,允许实体标签被索引并在搜索期间使用。命名实体标记器本身通常在数千或数万个由人类标记的示例上进行训练。然而,命名实体类有很长的尾巴,对于这些情况,标记的数据可能无法找到或在财务上证明。我们建议探索命名实体识别作为一个搜索任务,其中感兴趣的命名实体类是一个查询,而该类的实体是相关的“文档”。这个查询应该是什么样的?我们甚至可以用几十个标签执行NER风格的标签吗?这项研究提出了一种探索基于CRF的NER模型与手工制作的功能,以及我们如何将它们转化为搜索查询。

英文摘要:

Traditional information retrieval treats named entity recognition as a pre-indexing corpus annotation task, allowing entity tags to be indexed and used during search. Named entity taggers themselves are typically trained on thousands or tens of thousands of examples labeled by humans. However, there is a long tail of named entities classes, and for these cases, labeled data may be impossible to find or justify financially. We propose exploring named entity recognition as a search task, where the named entity class of interest is a query, and entities of that class are the relevant "documents". What should that query look like? Can we even perform NER-style labeling with tens of labels? This study presents an exploration of CRF-based NER models with handcrafted features and of how we might transform them into search queries.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑