类增量少样本事件检测
Class-Incremental Few-Shot Event Detection
AI总结:
本文提出类增量少样本事件检测任务,并设计Prompt-KD方法,通过多教师知识蒸馏和提示学习同时缓解旧知识遗忘与新类别过拟合问题,在FewEvent和MAVEN上取得优越性能。
摘要:
事件检测是信息抽取和知识图谱中的基础任务之一。然而,现实的事件检测系统通常需要不断处理新的事件类别。由于标注大量无标签实例耗时费力,这些新类别通常只有少量已标注实例。因此,本文提出了一项新任务,称为类增量少样本事件检测。然而,该任务面临两个问题,即旧知识遗忘和新类别过拟合。为解决这些问题,本文进一步提出了一种基于知识蒸馏和提示学习的新方法,称为Prompt-KD。具体而言,为处理旧知识遗忘问题,Prompt-KD设计了一个基于注意力的多教师知识蒸馏框架,其中在基类上预训练的祖先教师模型在所有学习会话中被重用,而父教师模型通过适配得到当前学生模型。另一方面,为应对少样本学习场景并缓解相应的新类别过拟合问题,Prompt-KD还配备了提示学习机制。在两个基准数据集FewEvent和MAVEN上的大量实验证明了Prompt-KD的优越性能。
英文摘要:
Event detection is one of the fundamental tasks in information extraction and knowledge graph. However, a realistic event detection system often needs to deal with new event classes constantly. These new classes usually have only a few labeled instances as it is time-consuming and labor-intensive to annotate a large number of unlabeled instances. Therefore, this paper proposes a new task, called class-incremental few-shot event detection. Nevertheless, this task faces two problems, i.e., old knowledge forgetting and new class overfitting. To solve these problems, this paper further presents a novel knowledge distillation and prompt learning based method, called Prompt-KD. Specifically, to handle the forgetting problem about old knowledge, Prompt-KD develops an attention based multi-teacher knowledge distillation framework, where the ancestor teacher model pre-trained on base classes is reused in all learning sessions, and the father teacher model derives the current student model via adaptation. On the other hand, in order to cope with the few-shot learning scenario and alleviate the corresponding new class overfitting problem, Prompt-KD is also equipped with a prompt learning mechanism. Extensive experiments on two benchmark datasets, i.e., FewEvent and MAVEN, demonstrate the superior performance of Prompt-KD.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。