Psyche-R1：通过统一的同理心、专业知识和推理实现可靠的心理语言模型
Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoning
AI总结：
研究旨在将大语言模型应用于心理领域，提出Psyche-R1模型。通过设计数据合成管道生成大量心理问题及对话，采用混合训练策略，经实验验证该模型在多个心理基准测试中有效，7B的Psyche-R1能取得与671B的DeepSeek-R1相当的结果。
摘要：
在合格心理健康专业人员短缺的情况下，将大语言模型（LLMs）集成到心理应用中为减轻日益增长的心理健康障碍负担提供了一条有前景的途径。近期推理增强的LLMs在数学和编程方面取得了显著成绩，而心理领域的研究主要强调情感支持和同理心对话，对有助于生成准确回答的推理机制关注有限。本文提出了Psyche-R1，首个联合整合同理心、心理专业知识和推理的中文心理LLM，基于新颖的数据整理管道构建。具体设计了综合数据合成管道，生成超75k高质量心理问题及详细理由，还有73k同理心对话。采用混合训练策略，通过多LLM交叉选择策略识别具有挑战性的样本进行组相对策略优化（GRPO）以提高推理能力，其余数据用于监督微调（SFT）增强同理心回应生成和心理领域知识。大量实验结果证明了Psyche-R1在多个心理基准测试中的有效性，7B的Psyche-R1取得了与671B的DeepSeek-R1相当的结果。
英文摘要：
Amidst a shortage of qualified mental health professionals, the integration of large language models (LLMs) into psychological applications offers a promising way to alleviate the growing burden of mental health disorders. Recent reasoning-augmented LLMs have achieved remarkable performance in mathematics and programming, while research in the psychological domain has predominantly emphasized emotional support and empathetic dialogue, with limited attention to reasoning mechanisms that are beneficial to generating accurate responses. Therefore, in this paper, we propose \logopsyche\textit{Psyche-R1}, the first Chinese psychological LLM that jointly integrates empathy, psychological expertise, and reasoning, built upon a novel data curation pipeline. Specifically, we design a comprehensive data synthesis pipeline that produces over 75k high-quality psychological questions paired with detailed rationales, generated through an iterative prompt-rationale optimization procedure, along with 73k empathetic dialogues. Subsequently, we employ a hybrid training strategy wherein challenging samples are identified through a multi-LLM cross-selection strategy for group relative policy optimization (GRPO) to improve reasoning ability, while the remaining data are used for supervised fine-tuning (SFT) to enhance empathetic response generation and psychological domain knowledge. Extensive experiment results demonstrate the effectiveness of \textit{Psyche-R1} across several psychological benchmarks, where our 7B \textit{Psyche-R1} achieves comparable results to 671B \texttt{DeepSeek-R1}.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
