arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.18148cs.CLcs.AI
收藏

大型语言模型生成的回复被认为更具共情性

Large Language Models Produce Responses Perceived to be Empathic

The University of Texas at Austin(德克萨斯大学奥斯汀分校);Microsoft Research(微软研究院)

Yoon Kyung Lee, Jina Suh, Hongli Zhan, Junyi Jessy Li, Desmond C. Ong

AI总结:

该研究通过两项实验发现GPT4 Turbo、Llama2和Mistral生成的共情回复在人类评分中始终优于人类撰写的回复,并揭示了LLM独特的语言风格,表明其在同伴支持场景中具有应用潜力。

摘要:

大型语言模型(LLMs)在许多任务上表现出令人惊讶的性能,包括撰写展现共情的支持性信息。在本研究中,我们让这些模型针对描述常见生活经历的帖子生成共情回复,这些经历包括职场情境、育儿、人际关系以及其他引发焦虑和愤怒的情境。在两项研究(N=192、202)中,我们向人类评分者展示了由多个模型(GPT4 Turbo、Llama2 和 Mistral)撰写的多种回复,并让人们对这些回复看起来有多共情进行评分。我们发现,LLM 生成的回复始终被评价为比人类撰写的回复更具共情性。语言分析还表明,这些模型在使用标点符号、表情符号和特定词汇方面呈现出独特且可预测的“风格”。这些结果凸显了在共情很重要的情境中,利用 LLM 增强人类同伴支持的潜力。

英文摘要:

Large Language Models (LLMs) have demonstrated surprising performance on many tasks, including writing supportive messages that display empathy. Here, we had these models generate empathic messages in response to posts describing common life experiences, such as workplace situations, parenting, relationships, and other anxiety- and anger-eliciting situations. Across two studies (N=192, 202), we showed human raters a variety of responses written by several models (GPT4 Turbo, Llama2, and Mistral), and had people rate these responses on how empathic they seemed to be. We found that LLM-generated responses were consistently rated as more empathic than human-written responses. Linguistic analyses also show that these models write in distinct, predictable ``styles", in terms of their use of punctuation, emojis, and certain words. These results highlight the potential of using LLMs to enhance human peer support in contexts where empathy is important.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑