VerifiNER:基于知识接地推理与大语言模型的验证增强命名实体识别
VerifiNER: Verification-augmented NER via Knowledge-grounded Reasoning with Large Language Models
AI总结:
本文提出VerifiNER事后验证框架,利用大语言模型的推理能力结合实体知识识别并修正现有NER方法的错误预测,在生物医学数据集上验证了其模型无关的有效性及域外和低资源场景下的实用性。
摘要:
近年来,特定领域命名实体识别(NER)方法(如生物医学NER)取得了显著进展。然而,这些方法仍然缺乏忠实性,会产生错误的预测。我们假设实体知识可以用于验证预测的正确性。尽管知识具有实用性,但利用知识解决此类错误并非易事,因为知识本身并不直接指示真实标签。为此,我们提出了VerifiNER,这是一个事后验证框架,利用知识识别现有NER方法中的错误,并将其修正为更忠实的预测。我们的框架利用大语言模型的推理能力,在验证过程中充分基于知识和上下文信息进行接地。我们通过在生物医学数据集上的大量实验验证了VerifiNER的有效性。结果表明,VerifiNER作为一种模型无关的方法,能够成功验证现有模型的错误。对域外和低资源场景的进一步分析显示了VerifiNER在实际应用中的实用性。
英文摘要:
Recent approaches in domain-specific named entity recognition (NER), such as biomedical NER, have shown remarkable advances. However, they still lack of faithfulness, producing erroneous predictions. We assume that knowledge of entities can be useful in verifying the correctness of the predictions. Despite the usefulness of knowledge, resolving such errors with knowledge is nontrivial, since the knowledge itself does not directly indicate the ground-truth label. To this end, we propose VerifiNER, a post-hoc verification framework that identifies errors from existing NER methods using knowledge and revises them into more faithful predictions. Our framework leverages the reasoning abilities of large language models to adequately ground on knowledge and the contextual information in the verification process. We validate effectiveness of VerifiNER through extensive experiments on biomedical datasets. The results suggest that VerifiNER can successfully verify errors from existing models as a model-agnostic approach. Further analyses on out-of-domain and low-resource settings show the usefulness of VerifiNER on real-world applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。