arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2506.00081q-bio.OTcs.AIcs.HC

人工共情:基于AI的心理健康

Artificial Empathy: AI based Mental Health

Indiana University(印第安纳大学)

Aditya Naik, Jovi Thomas, Teja Sree Mandava, Himavanth Reddy Vemula

AI总结:

本文研究了用户对AI聊天机器人的使用情况及LLM聊天机器人在心理健康场景下的表现,发现其虽能提供匿名陪伴与安慰,但存在隐私安全、回应不当及缺乏危机敏感性等问题,为技术与心理健康护理行业优化AI支持提供了参考。

摘要:

许多人患有心理健康问题,但并非所有人都会寻求专业帮助或能够获得心理健康护理。AI聊天机器人已日益成为患有心理障碍或仅想找人倾诉的个体的首选。本文对曾使用过聊天机器人的参与者进行了研究,并对大型语言模型(LLM)聊天机器人进行了基于场景的测试。研究结果表明,AI聊天机器人主要被用作“五分钟心理治疗师”或无偏见的陪伴者。参与者赞赏聊天机器人的匿名性和无评判性。然而,也存在对隐私和敏感信息安全的担忧。基于场景的LLM聊天机器人测试突显了其他问题。部分聊天机器人始终给予安慰,使用表情符号和名字增添个人色彩,并迅速建议寻求专业帮助。但也存在语气不一致、偶尔出现不当回应(如随意或浪漫)以及缺乏危机敏感性等局限性,特别是在识别危险信号语言和适当地升级回应方面。这些发现可为技术和心理健康护理行业提供参考,指导其如何更好地利用AI聊天机器人来支持处于情感困难时期的个体。

英文摘要:

Many people suffer from mental health problems but not everyone seeks professional help or has access to mental health care. AI chatbots have increasingly become a go-to for individuals who either have mental disorders or simply want someone to talk to. This paper presents a study on participants who have previously used chatbots and a scenario-based testing of large language model (LLM) chatbots. Our findings indicate that AI chatbots were primarily utilized as a "Five minute therapist" or as a non-judgmental companion. Participants appreciated the anonymity and lack of judgment from chatbots. However, there were concerns about privacy and the security of sensitive information. The scenario-based testing of LLM chatbots highlighted additional issues. Some chatbots were consistently reassuring, used emojis and names to add a personal touch, and were quick to suggest seeking professional help. However, there were limitations such as inconsistent tone, occasional inappropriate responses (e.g., casual or romantic), and a lack of crisis sensitivity, particularly in recognizing red flag language and escalating responses appropriately. These findings can inform both the technology and mental health care industries on how to better utilize AI chatbots to support individuals during challenging emotional periods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑