KnowPrompt:面向关系抽取的知识感知提示调优与协同优化
KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction
AI总结:
KnowPrompt通过将关系标签中的潜在知识注入可学习的虚拟类型词和答案词,并结合结构化约束协同优化表示,在标准和低资源场景下有效提升了关系抽取的提示调优性能。
摘要:
近年来,提示调优在特定的小样本分类任务上取得了令人鼓舞的成果。提示调优的核心思想是将文本片段(即模板)插入输入中,从而把分类任务转化为掩码语言建模问题。然而,对于关系抽取而言,确定合适的提示模板需要领域专业知识,而且获得合适的标签词也繁琐耗时。此外,关系标签之间存在着大量不可忽视的语义和先验知识。为此,我们专注于将关系标签之间的知识融入关系抽取的提示调优中,并提出了一种具有协同优化的知识感知提示调优方法(KnowPrompt)。具体来说,我们通过可学习的虚拟类型词和答案词,将关系标签中蕴含的潜在知识注入提示构建过程。然后,我们利用结构化约束协同优化它们的表示。在五个数据集上、标准和低资源设置下的大量实验结果表明了我们方法的有效性。我们的代码和数据集已在 https://github.com/zjunlp/KnowPrompt 公开,以便结果复现。
英文摘要:
Recently, prompt-tuning has achieved promising results for specific few-shot classification tasks. The core idea of prompt-tuning is to insert text pieces (i.e., templates) into the input and transform a classification task into a masked language modeling problem. However, for relation extraction, determining an appropriate prompt template requires domain expertise, and it is cumbersome and time-consuming to obtain a suitable label word. Furthermore, there exists abundant semantic and prior knowledge among the relation labels that cannot be ignored. To this end, we focus on incorporating knowledge among relation labels into prompt-tuning for relation extraction and propose a Knowledge-aware Prompt-tuning approach with synergistic optimization (KnowPrompt). Specifically, we inject latent knowledge contained in relation labels into prompt construction with learnable virtual type words and answer words. Then, we synergistically optimize their representation with structured constraints. Extensive experimental results on five datasets with standard and low-resource settings demonstrate the effectiveness of our approach. Our code and datasets are available in https://github.com/zjunlp/KnowPrompt for reproducibility.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。