arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2402.12738cs.CLcs.AIcs.HC

大型语言模型能否用于提供心理咨询?基于角色扮演对话的GPT-4生成响应分析

Can Large Language Models be Used to Provide Psychological Counselling? An Analysis of GPT-4-Generated Responses Using Role-play Dialogues

The University of Electro-Communications(电气通信大学);iDEAR Human Support Service(iDEAR人文支持服务);Japanese Organization of Mental Health and Educational Agencies(日本心理健康与教育机构组织)

Michimasa Inaba, Mariko Ukiyo, Keiko Takamizo

AI总结:

本研究通过角色扮演对话收集专家咨询师数据并标注意图,由第三方咨询师评估GPT-4与人类咨询师在相同情境下的响应适当性,发现GPT-4生成的响应与人类咨询师具有竞争力,验证了大型语言模型用于心理咨询的可行性。

摘要:

心理健康护理对现代社会构成日益严峻的挑战。在此背景下,利用信息技术解决心理健康问题的研究激增,其中包括旨在开发咨询对话系统的研究。然而,针对使用大型语言模型的咨询对话系统,仍需更多性能评估。在本研究中,我们通过涉及专家咨询师的角色扮演场景收集了咨询对话数据,并对咨询师的发言进行了意图标注。为确定对话系统在真实咨询场景中的可行性,第三方咨询师在角色扮演对话数据的相同情境下,评估了人类咨询师响应与GPT-4生成响应的适当性。评估结果分析表明,GPT-4生成的响应与人类咨询师的响应具有竞争力。

英文摘要:

Mental health care poses an increasingly serious challenge to modern societies. In this context, there has been a surge in research that utilizes information technologies to address mental health problems, including those aiming to develop counseling dialogue systems. However, there is a need for more evaluations of the performance of counseling dialogue systems that use large language models. For this study, we collected counseling dialogue data via role-playing scenarios involving expert counselors, and the utterances were annotated with the intentions of the counselors. To determine the feasibility of a dialogue system in real-world counseling scenarios, third-party counselors evaluated the appropriateness of responses from human counselors and those generated by GPT-4 in identical contexts in role-play dialogue data. Analysis of the evaluation results showed that the responses generated by GPT-4 were competitive with those of human counselors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑