arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.07714cs.CLcs.SI
收藏

促进在线心理健康支持中的共情对话:一种强化学习方法

Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approach

University of Washington(华盛顿大学);Stanford University(斯坦福大学)

Ashish Sharma, Inna W. Lin, Adam S. Miner, David C. Atkins, Tim Althoff

摘要:

在线点对点支持平台使数百万寻求和提供心理健康支持的人能够进行对话。如果成功,基于网络的心理健康对话可以改善获得治疗的机会,减少全球疾病负担。心理学家一再证明,同理心,理解和感受他人情绪和经历的能力,是在支持性对话中取得积极成果的关键组成部分。然而,最近的研究表明,在在线心理健康平台上,高度移情的对话很少见。在本文中,我们致力于改善在线心理健康支持对话中的同理心。我们引入了一个新的移情重写任务,旨在将低移情会话帖子转换为更高的移情。学习这种转换是具有挑战性的,需要深刻理解移情,同时通过文本流畅性和会话背景的特异性来保持会话质量。在这里,我们提出了PARTNER,一个深度强化学习代理,它学会对帖子进行编辑级别的编辑,以便在保持对话质量的同时提高同理心的表达水平。我们的RL代理利用一个策略网络,基于一个Transformer语言模型改编自GPT-2,它执行的双重任务,生成候选移情句子,并添加这些句子在适当的位置。在培训过程中,我们奖励那些在保持文本流畅性、上下文特异性和多样性的同时增加帖子中的同理心的转换。通过自动和人工评估的结合,我们证明了PARTNER成功地产生了更多的移情,具体和多样化的反应,并在风格转换和移情对话生成等相关任务中优于NLP方法。我们的工作对促进基于网络的平台上的共情对话有直接的影响。

英文摘要:

Online peer-to-peer support platforms enable conversations between millions of people who seek and provide mental health support. If successful, web-based mental health conversations could improve access to treatment and reduce the global disease burden. Psychologists have repeatedly demonstrated that empathy, the ability to understand and feel the emotions and experiences of others, is a key component leading to positive outcomes in supportive conversations. However, recent studies have shown that highly empathic conversations are rare in online mental health platforms. In this paper, we work towards improving empathy in online mental health support conversations. We introduce a new task of empathic rewriting which aims to transform low-empathy conversational posts to higher empathy. Learning such transformations is challenging and requires a deep understanding of empathy while maintaining conversation quality through text fluency and specificity to the conversational context. Here we propose PARTNER, a deep reinforcement learning agent that learns to make sentence-level edits to posts in order to increase the expressed level of empathy while maintaining conversation quality. Our RL agent leverages a policy network, based on a transformer language model adapted from GPT-2, which performs the dual task of generating candidate empathic sentences and adding those sentences at appropriate positions. During training, we reward transformations that increase empathy in posts while maintaining text fluency, context specificity and diversity. Through a combination of automatic and human evaluation, we demonstrate that PARTNER successfully generates more empathic, specific, and diverse responses and outperforms NLP methods from related tasks like style transfer and empathic dialogue generation. Our work has direct implications for facilitating empathic conversations on web-based platforms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑