arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.08010cs.CL
收藏

ProKnow:用于心理健康诊断辅助中安全约束且可解释问题生成的过程知识

ProKnow: Process Knowledge for Safety Constrained and Explainable Question Generation for Mental Health Diagnostic Assistance

Kaushik Roy, Manas Gaur, Misagh Soltani, Vipula Rawte, Ashwin Kalyan, Amit Sheth

AI总结:

本文提出 ProKnow 过程知识框架及诊断对话数据集,通过显式建模安全、知识获取与可解释性增强语言模型,显著提升心理健康诊断问题生成的安全性与可解释性。

摘要:

当前的虚拟心理健康助手(VMHAs)提供咨询和建议性护理。它们回避患者诊断辅助,因为缺乏安全约束和专业临床过程知识方面的训练。在本工作中,我们将 Proknow 定义为一组有序信息,这些信息映射到循证指南,或映射到某一领域专家对概念理解的类别。我们还引入了一个由医疗保健专业人员使用、受安全约束和 Proknow 指导的诊断对话新数据集。我们开发了一种自然语言问题生成(NLG)方法,以交互式方式从患者处收集诊断信息。我们展示了在该数据集上使用最先进大规模语言模型(LMs)的局限性。我们的算法通过显式建模安全性、知识获取和可解释性来建模过程知识。采用 ProKnow 指导方法增强的 LMs 在抑郁和焦虑领域生成的问题安全性提高了 89%。所生成问题的可解释性通过计算其与抑郁和焦虑知识库中概念的相似度来评估。总体而言,无论使用何种类型的 LMs,经我们的 ProKnow 增强后,在安全性、可解释性和过程指导的问题生成方面,相比简单的预训练 LMs 平均实现了 82% 的提升。我们通过引入安全性、可解释性和过程知识遵循度三个新的评估指标,从定性和定量两方面评估了所提出的 ProKnow 指导方法的有效性。

英文摘要:

Current Virtual Mental Health Assistants (VMHAs) provide counseling and suggestive care. They refrain from patient diagnostic assistance because they lack training in safety-constrained and specialized clinical process knowledge. In this work, we define Proknow as an ordered set of information that maps to evidence-based guidelines or categories of conceptual understanding to experts in a domain. We also introduce a new dataset of diagnostic conversations guided by safety constraints and Proknow that healthcare professionals use. We develop a method for natural language question generation (NLG) that collects diagnostic information from the patient interactively. We demonstrate the limitations of using state-of-the-art large-scale language models (LMs) on this dataset. Our algorithm models the process knowledge through explicitly modeling safety, knowledge capture, and explainability. LMs augmented with ProKnow guided method generated 89% safer questions in the depression and anxiety domain. The Explainability of the generated question is assessed by computing similarity with concepts in depression and anxiety knowledge bases. Overall, irrespective of the type of LMs augmented with our ProKnow, we achieved an average 82% improvement over simple pre-trained LMs on safety, explainability, and process-guided question generation. We qualitatively and quantitatively evaluate the efficacy of the proposed ProKnow-guided methods by introducing three new evaluation metrics for safety, explainability, and process knowledge adherence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑