Large Language Models (LLMs) have demonstrated surprising performance on many tasks, including writing supportive messages that display empathy. Here, we had these models generate empathic messages in response to posts describing common life experiences, such as workplace situations, parenting, relationships, and other anxiety- and anger-eliciting situations. Across two studies (N=192, 202), we showed human raters a variety of responses written by several models (GPT4 Turbo, Llama2, and Mistral), and had people rate these responses on how empathic they seemed to be. We found that LLM-generated responses were consistently rated as more empathic than human-written responses. Linguistic analyses also show that these models write in distinct, predictable ``styles", in terms of their use of punctuation, emojis, and certain words. These results highlight the potential of using LLMs to enhance human peer support in contexts where empathy is important.
AI generates well-liked but templatic empathic responses
Department of Psychology, The University of Texas at Austin(心理学系,德克萨斯大学奥斯汀分校);Department of Linguistics, The University of Texas at Austin(语言学系,德克萨斯大学奥斯汀分校);Department of Computer Science and Engineering, The University of Washington(计算机科学与工程系,华盛顿大学);Microsoft Research(微软研究院);Toyota Research Institute(丰田研究院)
CARE: An Explainable Computational Framework for Assessing Client-Perceived Therapeutic Alliance Using Large Language Models
Zhejiang University(浙江大学);Westlake University(西湖大学);Department of Psychology, Jing Hengyi School of Education, Hangzhou Normal University(心理系,金恒毅教育学院,杭州师范大学)
NARRA-Gym for Evaluating Interactive Narrative Agents
University of Notre Dame(诺丁汉大学);LMU Munich(慕尼黑大学);Munich Center for Machine Learning(慕尼黑机器学习中心);University of Pennsylvania(宾夕法尼亚大学);Lehigh University(莱恩大学);Massachusetts Institute of Technology(麻省理工学院);Bake AI UC Santa Barbara(加州大学圣芭芭拉分校);University of Washington(华盛顿大学)
Catch Me if You Search: When Contextual Web Search Results Affect the Detection of Hallucinations
The Pennsylvania State University(宾夕法尼亚州立大学);Department of Communication & Center for Trustworthy Artificial Intelligence (CTAI)(通信系与可信人工智能中心);Seoul National University(首尔国立大学)
LLMs can persuade only psychologically susceptible humans on societal issues, via trust in AI and emotional appeals, amid logical fallacies
organization= CogNosco Lab, Department of Psychology;Cognitive Science, University of Trento , city= Rovereto , country= Italy;organization= Institute of Information Science;Technologies ``Alessandro Faedo", National Research Council , country= Italy;organization= Thomas Lord Department of Computer Science, University of Southern California , city= Los Angeles , state= California , country= USA;organization= Department of Sociology;Social Research, University of Trento , city= Trento , country= Italy;organization= Centre for Behavioural;Implementation Sciences in Medicine (BISI), National University of Singapore , city= Singapore , country= Singapore
Empathy Level Alignment via Reinforcement Learning for Empathetic Response Generation
School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机与信息工程学院);School of Computer Science and Technology, Dalian University of Technology(大连理工大学计算机科学与技术学院)