arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.18253cs.CL
收藏

通过软标签和目标词预测增强隐喻检测

Enhancing Metaphor Detection through Soft Labels and Target Word Prediction

College of Computer Science and Technology, Harbin Engineering University(哈尔滨工程大学计算机科学与技术学院)

Kaidi Jia, Rongsheng Li

AI总结:

本文提出融合知识蒸馏与提示学习的隐喻检测框架,通过目标词遮蔽预测和教师模型软标签缓解规则误用与数据稀疏问题,并在多个数据集上达到最先进性能。

摘要:

隐喻在我们的日常交流中发挥着重要作用,但检测它们却颇具挑战。传统方法往往受困于语言规则的不当应用,并且容易忽视数据稀疏性。为解决这些问题,我们将知识蒸馏和提示学习融入隐喻检测。我们的方法围绕一个专为隐喻检测设计的定制化提示学习框架展开。通过策略性地遮蔽目标词并提供相关提示数据,我们引导模型准确预测这些词的上下文含义。该方法不仅缓解了由词汇字面意义引发的混淆,还确保了语言规则在隐喻检测中的有效应用。此外,我们引入了一个教师模型来生成有价值的软标签。这些软标签提供了与标签平滑相似的效果,有助于防止模型变得过度自信,并有效应对数据稀疏性挑战。实验结果表明,我们的模型取得了最先进的性能,这一点由其在多个数据集上的出色结果所证明。

英文摘要:

Metaphors play a significant role in our everyday communication, yet detecting them presents a challenge. Traditional methods often struggle with improper application of language rules and a tendency to overlook data sparsity. To address these issues, we integrate knowledge distillation and prompt learning into metaphor detection. Our approach revolves around a tailored prompt learning framework specifically designed for metaphor detection. By strategically masking target words and providing relevant prompt data, we guide the model to accurately predict the contextual meanings of these words. This approach not only mitigates confusion stemming from the literal meanings of the words but also ensures effective application of language rules for metaphor detection. Furthermore, we've introduced a teacher model to generate valuable soft labels. These soft labels provide a similar effect to label smoothing and help prevent the model from becoming over confident and effectively addresses the challenge of data sparsity. Experimental results demonstrate that our model has achieved state-of-the-art performance, as evidenced by its remarkable results across various datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑