arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.02122cs.LGcs.AIcs.CL
收藏

面向可解释抑郁症检测的深度知识注入

Deep Knowledge-Infusion For Explainable Depression Detection

National Institute of Technology Kurukshetra(库鲁克谢特拉国家理工学院)

Sumit Dalal, Sarika Jain, Mayank Dave

AI总结:

本文提出知识注入神经网络KiNN,融合抑郁症领域本体DFO和常识知识COMET,在提升检测性能的同时为临床医生提供用户级可解释性,并在多个数据集上优于MentalBERT等基线模型。

摘要:

在社交媒体上发现个体抑郁症已变得日益重要。研究人员采用机器学习/深度学习或基于词典的方法进行自动化抑郁症检测。基于词典的方法具有可解释性且易于实现,其通过将用户帖子中的词语与抑郁症词典进行匹配来工作,但不考虑上下文。虽然深度学习模型能够利用上下文信息,但其黑箱特性限制了它们在该领域的应用。尽管LIME和SHAP等替代模型可以为深度学习模型生成解释,但这些解释更适合开发者,对最终用户的用处有限。我们提出了一种知识注入神经网络(KiNN),将来自DepressionFeature本体(DFO)的领域特定知识融入神经网络中,使模型具备面向用户级别的可解释性,涉及临床医生能够理解的概念和过程。此外,还注入了在ATOMIC上训练的Commonsense Transformer(COMET)中的常识知识,以考虑用户帖子在抑郁症检测中的一般情感方面。该模型在三个经过专家整理的抑郁症相关数据集上进行了评估。我们观察到,与最佳领域特定模型MentalBERT相比,该模型在CLEF e-Risk上的性能提升具有统计显著性(p<0.1)(MCC提高25%,F1提高12%)。在PRIMATE数据集上也观察到类似趋势,所提模型的表现优于MentalBERT(MCC提高2.5%,F1提高19%)。观察结果证实,与事后模型解释相比,所生成的解释对心理健康专业人员(MHP)更具信息量。结果表明,KiNN的用户级可解释性也超越了基线模型的性能,并且能够在其他基线模型不足的地方提供解释。在KiNN中注入领域知识和常识知识,增强了GPT-3.5等模型生成与应用相关的解释的能力。

英文摘要:

Discovering individuals depression on social media has become increasingly important. Researchers employed ML/DL or lexicon-based methods for automated depression detection. Lexicon based methods, explainable and easy to implement, match words from user posts in a depression dictionary without considering contexts. While the DL models can leverage contextual information, their black-box nature limits their adoption in the domain. Though surrogate models like LIME and SHAP can produce explanations for DL models, the explanations are suitable for the developer and of limited use to the end user. We propose a Knolwedge-infused Neural Network (KiNN) incorporating domain-specific knowledge from DepressionFeature ontology (DFO) in a neural network to endow the model with user-level explainability regarding concepts and processes the clinician understands. Further, commonsense knowledge from the Commonsense Transformer (COMET) trained on ATOMIC is also infused to consider the generic emotional aspects of user posts in depression detection. The model is evaluated on three expertly curated datasets related to depression. We observed the model to have a statistically significant (p<0.1) boost in performance over the best domain-specific model, MentalBERT, across CLEF e-Risk (25% MCC increase, 12% F1 increase). A similar trend is observed across the PRIMATE dataset, where the proposed model performed better than MentalBERT (2.5% MCC increase, 19% F1 increase). The observations confirm the generated explanations to be informative for MHPs compared to post hoc model explanations. Results demonstrated that the user-level explainability of KiNN also surpasses the performance of baseline models and can provide explanations where other baselines fall short. Infusing the domain and commonsense knowledge in KiNN enhances the ability of models like GPT-3.5 to generate application-relevant explanations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑