arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.01993cs.AI
收藏

面向隐私保护的大型语言模型在心理健康支持中的应用

Towards Privacy-Preserving Mental Health Support with Large Language Models

IEEE

Dong Xue, Jicheng Tu, Ming Wang, Xin Yan, Fangzhou Liu, Jie Hu

AI总结:

本文提出MindChat和MindCorpus,通过多智能体角色扮演框架生成高质量咨询数据,结合联邦学习和差分隐私优化,实现隐私保护的高效心理健康支持系统。

摘要:

大型语言模型(LLMs)在心理健康支持中展现出潜力,但训练此类模型受到真实咨询对话稀缺性和敏感性的限制。本文介绍了MindChat,一种用于心理健康支持的隐私保护LLM,以及MindCorpus,通过多智能体角色扮演框架构建的合成多轮咨询数据集。为合成高质量咨询数据,开发的对话构建框架采用双闭环反馈设计,通过角色扮演整合心理学专业知识和咨询技巧:(i)回合级批评与修订以提高会话连贯性和咨询适当性,(ii)会话级策略优化以逐步丰富咨询师行为。为在去中心化数据所有权下缓解隐私风险,我们使用联邦学习配合参数高效LoRA适配器对基础模型进行微调,并结合差分隐私优化以降低成员和记忆风险。在合成数据质量评估和咨询能力评估实验中,结果显示MindCorpus提升了训练效果,而MindChat在自动LLM评估和人工评估协议下与现有通用和咨询导向LLM基线竞争,同时在成员推断攻击下表现出较低的隐私泄露。

英文摘要:

Large language models (LLMs) have shown promise for mental health support, yet training such models is constrained by the scarcity and sensitivity of real counseling dialogues. In this article, we present MindChat, a privacy-preserving LLM for mental health support, together with MindCorpus, a synthetic multi-turn counseling dataset constructed via a multi-agent role-playing framework. To synthesize high-quality counseling data, the developed dialogue-construction framework employs a dual closed-loop feedback design to integrate psychological expertise and counseling techniques through role-playing: (i) turn-level critique-and-revision to improve coherence and counseling appropriateness within a session, and (ii) session-level strategy refinement to progressively enrich counselor behaviors across sessions. To mitigate privacy risks under decentralized data ownership, we fine-tune the base model using federated learning with parameter-efficient LoRA adapters and incorporate differentially private optimization to reduce membership and memorization risks. Experiments on synthetic-data quality assessment and counseling capability evaluation show that MindCorpus improves training effectiveness and that MindChat is competitive with existing general and counseling-oriented LLM baselines under both automatic LLM-judge and human evaluation protocols, while exhibiting reduced privacy leakage under membership inference attacks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑