arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.03029cs.CL
收藏

苏格拉底推理改进正向文本改写

Socratic Reasoning Improves Positive Text Rewriting

Technical University of Darmstadt(达姆施塔特工业大学);University of Macau(澳门大学)

Anmol Goel, Nico Daheim, Christian Montag, Iryna Gurevych

AI总结:

本研究针对现有正向文本改写忽略推理过程的问题,提出SocraticReframe框架,用合成苏格拉底推理理由扩充数据集,显著提升了开源大语言模型的改写效果,验证了LLM推理与心理治疗技术结合的潜力。

摘要:

将消极想法重构为积极想法是多种心理健康与心理治疗认知方法的核心,基于大语言模型解决方案可让这些方法更易获取。这类重构通常难度较大,需要多步推理来发掘消极想法的深层问题并将其转化得更积极。然而,当前数据集和模型都采用单步重构想法,忽略了这一推理过程。本研究中,我们通过名为\textsc{SocraticReframe}的新型框架,用合成生成的苏格拉底推理理由扩充正向文本改写开源数据集,填补这一空白。SocraticReframe使用一系列问答对来推理想法改写过程。我们依据心理治疗研究标准开展的自动评估和人工评估均显示,这类苏格拉底推理理由显著提升了不同开源大语言模型的正向文本改写效果。我们在一项经IRB批准的标注研究中,通过领域专家和心理学学生的专家判断验证了我们的框架及合成推理理由。我们的研究结果凸显了利用大语言模型推理与成熟心理治疗技术之间的协同作用,构建辅助解决方案来重构消极想法的潜力。

英文摘要:

Reframing a negative into a positive thought is at the crux of several cognitive approaches to mental health and psychotherapy that could be made more accessible by large language model-based solutions. Such reframing is typically non-trivial and requires multiple rationalization steps to uncover the underlying issue of a negative thought and transform it to be more positive. However, this rationalization process is currently neglected by both datasets and models which reframe thoughts in one step. In this work, we address this gap by augmenting open-source datasets for positive text rewriting with synthetically-generated Socratic rationales using a novel framework called \textsc{SocraticReframe}. SocraticReframe uses a sequence of question-answer pairs to rationalize the thought rewriting process. We show that such Socratic rationales significantly improve positive text rewriting for different open-source LLMs according to both automatic and human evaluations guided by criteria from psychotherapy research. We validate our framework and the synthetic rationalizations with expert judgements from domain experts and psychology students in an IRB-approved annotation study. Our findings highlight the potential of utilizing the synergy between LLM reasoning and established psychotherapy techniques to build assistive solutions for reframing negative thoughts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑