基于能量学习的域外意图检测置信度分布分解
Disentangling Confidence Score Distribution for Out-of-Domain Intent Detection with Energy-Based Learning
摘要:
在面向任务的对话系统中,从用户查询中检测出域外(OOD)或未知意图是必不可少的。传统的基于softmax的置信度得分容易受到过度自信问题的影响。在本文中,我们提出了一个简单但强大的基于能量的评分函数来检测OOD样本的能量分数高于IND样本。此外,给定一小组标记的OOD样本,我们引入了一个基于能量的利润目标监督OOD检测明确区分OOD样本从IND。综合实验和分析表明,该方法有助于理清IND和OOD数据的置信度分布。\footnote{Our code is available at \url{https://github.com/pris-nlp/EMNLP2022-energy_for_OOD/}.}
英文摘要:
Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. Traditional softmax-based confidence scores are susceptible to the overconfidence issue. In this paper, we propose a simple but strong energy-based score function to detect OOD where the energy scores of OOD samples are higher than IND samples. Further, given a small set of labeled OOD samples, we introduce an energy-based margin objective for supervised OOD detection to explicitly distinguish OOD samples from INDs. Comprehensive experiments and analysis prove our method helps disentangle confidence score distributions of IND and OOD data.\footnote{Our code is available at \url{https://github.com/pris-nlp/EMNLP2022-energy_for_OOD/}.}
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。