大型语言模型能否用于提供心理咨询?基于角色扮演对话的GPT-4生成响应分析
Can Large Language Models be Used to Provide Psychological Counselling? An Analysis of GPT-4-Generated Responses Using Role-play Dialogues
AI总结:
本研究通过角色扮演对话收集专家咨询师数据并标注意图,由第三方咨询师评估GPT-4与人类咨询师在相同情境下的响应适当性,发现GPT-4生成的响应与人类咨询师具有竞争力,验证了大型语言模型用于心理咨询的可行性。
摘要:
心理健康护理对现代社会构成日益严峻的挑战。在此背景下,利用信息技术解决心理健康问题的研究激增,其中包括旨在开发咨询对话系统的研究。然而,针对使用大型语言模型的咨询对话系统,仍需更多性能评估。在本研究中,我们通过涉及专家咨询师的角色扮演场景收集了咨询对话数据,并对咨询师的发言进行了意图标注。为确定对话系统在真实咨询场景中的可行性,第三方咨询师在角色扮演对话数据的相同情境下,评估了人类咨询师响应与GPT-4生成响应的适当性。评估结果分析表明,GPT-4生成的响应与人类咨询师的响应具有竞争力。
英文摘要:
Mental health care poses an increasingly serious challenge to modern societies. In this context, there has been a surge in research that utilizes information technologies to address mental health problems, including those aiming to develop counseling dialogue systems. However, there is a need for more evaluations of the performance of counseling dialogue systems that use large language models. For this study, we collected counseling dialogue data via role-playing scenarios involving expert counselors, and the utterances were annotated with the intentions of the counselors. To determine the feasibility of a dialogue system in real-world counseling scenarios, third-party counselors evaluated the appropriateness of responses from human counselors and those generated by GPT-4 in identical contexts in role-play dialogue data. Analysis of the evaluation results showed that the responses generated by GPT-4 were competitive with those of human counselors.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。