arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2411.00533cs.CLcs.AI
收藏

ReverseNER:一种基于自生成示例驱动的大语言模型零样本命名实体识别框架

ReverseNER: A Self-Generated Example-Driven Framework for Zero-Shot Named Entity Recognition with Large Language Models

School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件学院);China Mobile System Integration Co.,Ltd.(中移系统集成有限公司);China Mobile Communications Group Co.,Ltd.(中国移动通信集团有限公司)

Anbang Wang, Difei Mei, Zhichao Zhang, Xiuxiu Bai, Ran Yao, Zewen Fang, Min Hu, Zhirui Cao, Haitao Sun, Yifeng Guo, Hongyao Zhou, Yu Guo

AI总结:

本文提出ReverseNER框架,通过逆向NER过程生成实体标注示例库,并结合实体级自一致性评分机制,显著提升了大语言模型在零样本命名实体识别任务中的性能。

摘要:

本文提出了ReverseNER,旨在克服大语言模型(LLMs)在零样本命名实体识别(NER)任务中因依赖预先提供的示例而产生的局限性。ReverseNER通过构建一个由数十个实体标注句子组成的可靠示例库来解决这一挑战,这些句子通过NER的逆向过程生成。具体而言,传统NER方法是在句子中标注实体,而ReverseNER则通过使用LLM从实体定义生成实体,随后将其扩展为完整句子来逆转该过程。在实体扩展过程中,LLM被引导通过复制一组特定特征句子的结构来生成句子,这些特征句子是通过聚类从任务句子中提取的。该扩展过程产生了数十个实体标注的与任务相关的句子。在构建示例库之后,该方法为每个任务句子选择几个语义相似的实体标注示例作为参考,以促进LLM的实体识别。我们还提出了一种实体级自一致性评分机制,以提高LLM的NER性能。实验表明,ReverseNER显著优于其他使用LLM的零样本NER方法,标志着在没有标注数据的领域NER方面的显著改进,同时降低了计算资源消耗。

英文摘要:

This paper presents ReverseNER, a method aimed at overcoming the limitation of large language models (LLMs) in zero-shot named entity recognition (NER) tasks, arising from their reliance on pre-provided demonstrations. ReverseNER tackles this challenge by constructing a reliable example library composed of dozens of entity-labeled sentences, generated through the reverse process of NER. Specifically, while conventional NER methods label entities in a sentence, ReverseNER features reversing the process by using an LLM to generate entities from their definitions and subsequently expand them into full sentences. During the entity expansion process, the LLM is guided to generate sentences by replicating the structures of a set of specific \textsl{feature sentences}, extracted from the task sentences by clustering. This expansion process produces dozens of entity-labeled task-relevant sentences. After constructing the example library, the method selects several semantically similar entity-labeled examples for each task sentence as references to facilitate the LLM's entity recognition. We also propose an entity-level self-consistency scoring mechanism to improve NER performance with LLMs. Experiments show that ReverseNER significantly outperforms other zero-shot NER methods with LLMs, marking a notable improvement in NER for domains without labeled data, while declining computational resource consumption.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑