arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.10073cs.CL
收藏

两者皆重要:在不损害通用智能的前提下提升大语言模型的情绪智能

Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence

Harbin Institute of Technology(哈尔滨工业大学);Huawei Inc.(华为公司)

Weixiang Zhao, Zhuojun Li, Shilong Wang, Yang Wang, Yulin Hu, Yanyan Zhao, Chen Wei, Bing Qin

AI总结:

本文构建覆盖情绪感知、认知与表达的 EiBench,并提出模块化参数扩展与内外调制的 MoEI 方法,在 Flan-T5 和 LLaMA-2-Chat 上实现情绪智能提升且不损害通用智能。

摘要:

情绪智能(EI)由情绪感知、情绪认知和情绪表达组成,在改善当前基于大语言模型(LLM)的对话式通用AI助手的用户交互体验方面发挥着关键作用。以往工作主要通过在EI相关分类或回归任务上进行简单微调来提高其情绪感知能力。然而,这会导致EI增强不完整,并造成通用智能(GI)的灾难性遗忘。为此,我们首先推出 EiBench,这是一个采用文本到文本形式、带有任务指令的大规模EI相关任务集合,覆盖EI的全部三个方面,为全面增强LLM的EI奠定了坚实基础。随后,我们提出一种新颖的模块化情绪智能增强方法 MoEI(Modular Emotional Intelligence enhancement method),该方法由模块化参数扩展和内部—相互调制组成,旨在全面增强LLM的EI,同时不损害其GI。在两个具有代表性的基于LLM的助手 Flan-T5 和 LLaMA-2-Chat 上进行的大量实验,证明了 MoEI 在保持GI的同时提升EI的有效性。

英文摘要:

Emotional Intelligence (EI), consisting of emotion perception, emotion cognition and emotion expression, plays the critical roles in improving user interaction experience for the current large language model (LLM) based conversational general AI assistants. Previous works mainly focus on raising the emotion perception ability of them via naive fine-tuning on EI-related classification or regression tasks. However, this leads to the incomplete enhancement of EI and catastrophic forgetting of the general intelligence (GI). To this end, we first introduce \textsc{EiBench}, a large-scale collection of EI-related tasks in the text-to-text formation with task instructions that covers all three aspects of EI, which lays a solid foundation for the comprehensive EI enhancement of LLMs. Then a novel \underline{\textbf{Mo}}dular \underline{\textbf{E}}motional \underline{\textbf{I}}ntelligence enhancement method (\textbf{MoEI}), consisting of Modular Parameter Expansion and intra-inter modulation, is proposed to comprehensively enhance the EI of LLMs without compromise their GI. Extensive experiments on two representative LLM-based assistants, Flan-T5 and LLaMA-2-Chat, demonstrate the effectiveness of MoEI to improving EI while maintain GI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑