arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.13115cs.HCcs.CY
收藏

基于生成式预训练模型的护理治疗聊天机器人的评估

An Evaluation of Generative Pre-Training Model-based Therapy Chatbot for Caregivers

Lu Wang, Munif Ishad Mujib, Jake Williams, George Demiris, Jina Huh-Yoo

摘要:

随着现成的智能家居产品的出现和更广泛的互联网采用,研究人员越来越多地探索智能计算应用程序,以提供更容易获得的健康和保健资源。像聊天机器人这样基于人工智能的系统有可能提供可以提供心理健康支持的服务。然而,现有的治疗聊天机器人通常是基于检索的,需要用户用一组受约束的答案来响应,这可能是不合适的,因为这种预先确定的询问可能不反映每个患者的独特情况。基于生成的方法,例如OpenAI GPT模型,可以允许在治疗聊天机器人环境中进行比以前方法更动态的对话。为了研究基于生成的模型在治疗聊天机器人环境中的潜力,我们使用GPT-2模型构建了一个聊天机器人。我们微调了306个治疗会议的成绩单之间的家庭照顾者与痴呆症患者和治疗师进行问题解决疗法。然后,我们使用三个元信息测量来评估模型的预训练和微调模型的基本质量:非单词输出的比例,响应的长度和情感成分。结果表明:(1)微调模型比预训练模型产生更多的非单词输出;(2)与预训练模型相比,微调模型产生的输出长度与治疗师的输出长度更相似;(3)与治疗师相比,预训练模型和微调模型都可能产生更多的消极输出和更少的积极输出。我们讨论了问题的潜在原因,开发治疗聊天机器人的影响和解决方案,并呼吁对基于AI的系统应用进行调查。

英文摘要:

With the advent of off-the-shelf intelligent home products and broader internet adoption, researchers increasingly explore smart computing applications that provide easier access to health and wellness resources. AI-based systems like chatbots have the potential to provide services that could provide mental health support. However, existing therapy chatbots are often retrieval-based, requiring users to respond with a constrained set of answers, which may not be appropriate given that such pre-determined inquiries may not reflect each patient's unique circumstances. Generative-based approaches, such as the OpenAI GPT models, could allow for more dynamic conversations in therapy chatbot contexts than previous approaches. To investigate the generative-based model's potential in therapy chatbot contexts, we built a chatbot using the GPT-2 model. We fine-tuned it with 306 therapy session transcripts between family caregivers of individuals with dementia and therapists conducting Problem Solving Therapy. We then evaluated the model's pre-trained and the fine-tuned model in terms of basic qualities using three meta-information measurements: the proportion of non-word outputs, the length of response, and sentiment components. Results showed that: (1) the fine-tuned model created more non-word outputs than the pre-trained model; (2) the fine-tuned model generated outputs whose length was more similar to that of the therapists compared to the pre-trained model; (3) both the pre-trained model and fine-tuned model were likely to generate more negative and fewer positive outputs than the therapists. We discuss potential reasons for the problem, the implications, and solutions for developing therapy chatbots and call for investigations of the AI-based system application.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑