通过使用小规模共情模型增强LLMs来提升共情回复生成
Enhancing Empathetic Response Generation by Augmenting LLMs with Small-scale Empathetic Models
AI总结:
本文提出混合共情框架(HEF),将小规模共情模型作为插件增强LLMs的细粒度情感检测和原因识别能力,从而提升共情回复生成质量。
摘要:
共情回复生成在AI中日益重要,需要对情感和认知的细致理解以及清晰的表达能力。当前的大型语言模型(LLMs)在回复表达方面表现出色;然而,它们缺乏深入理解情感和认知细微差别的能力,特别是在精确定位细粒度情感及其触发因素方面。相反,小规模共情模型(SEMs)在细粒度情感检测和详细的情感原因识别方面具有优势。为了利用LLMs和SEMs的互补优势,我们引入了混合共情框架(HEF)。HEF将SEMs视为灵活的插件,以改善LLMs对情感和认知的细致理解。在情感理解方面,HEF实施了两阶段情感预测策略,鼓励LLMs优先考虑SEMs强调的主要情感,然后是其他类别,这大大缓解了LLMs在细粒度情感检测中的困难。在认知理解方面,HEF采用情感原因感知策略,提示LLMs关注SEMs识别的关键情感引发词,从而提升LLMs识别情感原因的能力。这种协作方法使LLMs能够更精确地辨别情感并制定共情回复。我们在Empathetic-Dialogue数据集上验证了HEF,研究结果表明我们的框架增强了LLMs的精细化理解及其传达共情回复的能力。
英文摘要:
Empathetic response generation is increasingly significant in AI, necessitating nuanced emotional and cognitive understanding coupled with articulate response expression. Current large language models (LLMs) excel in response expression; however, they lack the ability to deeply understand emotional and cognitive nuances, particularly in pinpointing fine-grained emotions and their triggers. Conversely, small-scale empathetic models (SEMs) offer strength in fine-grained emotion detection and detailed emotion cause identification. To harness the complementary strengths of both LLMs and SEMs, we introduce a Hybrid Empathetic Framework (HEF). HEF regards SEMs as flexible plugins to improve LLM's nuanced emotional and cognitive understanding. Regarding emotional understanding, HEF implements a two-stage emotion prediction strategy, encouraging LLMs to prioritize primary emotions emphasized by SEMs, followed by other categories, substantially alleviates the difficulties for LLMs in fine-grained emotion detection. Regarding cognitive understanding, HEF employs an emotion cause perception strategy, prompting LLMs to focus on crucial emotion-eliciting words identified by SEMs, thus boosting LLMs' capabilities in identifying emotion causes. This collaborative approach enables LLMs to discern emotions more precisely and formulate empathetic responses. We validate HEF on the Empathetic-Dialogue dataset, and the findings indicate that our framework enhances the refined understanding of LLMs and their ability to convey empathetic responses.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。