arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.07129cs.CLcs.AI
收藏

探索用于检测心理障碍的大型语言模型

Exploring Large Language Models for Detecting Mental Disorders

AIRI;ISP RAS Research Center for Trusted Artificial Intelligence(俄罗斯科学院信息与系统研究信任人工智能研究中心);FRC CSC RAS(俄罗斯科学院应用数学与计算机科学研究所);MIPT(米哈伊尔·伊万诺维奇·普京高等经济学院);RUDN University(俄罗斯人民友谊大学);MBZUAI(马斯喀特大学人工智能研究所)

Gleb Kuzmin, Petr Strepetov, Maksim Stankevich, Natalia Chudova, Artem Shelmanov, Ivan Smirnov

AI总结:

本文比较了传统机器学习、基于编码器的模型和大型语言模型在检测抑郁与焦虑症上的表现,发现LLMs在嘈杂小数据集上表现更优,但基于临床确诊文本训练的编码器模型与心理语言学特征能达到可比性能。

摘要:

本文比较了传统机器学习方法、基于编码器的模型和大型语言模型(LLMs)在检测抑郁症和焦虑症任务上的有效性。研究考虑了五个俄语数据集,每个数据集在格式和定义目标病理类别的方法上各不相同。我们测试了基于语言特征的AutoML模型、基于编码器的Transformers的几种变体(如BERT),以及最先进的LLMs作为病理分类模型。结果表明,LLMs优于传统方法,特别是在文本长度和体裁差异显著的嘈杂和小型数据集上。然而,当在临床确诊抑郁症患者的文本上进行训练时,心理语言学特征和基于编码器的模型可以达到与语言模型相当的性能,突显了它们在特定临床应用中的潜在有效性。

英文摘要:

This paper compares the effectiveness of traditional machine learning methods, encoder-based models, and large language models (LLMs) on the task of detecting depression and anxiety. Five Russian-language datasets were considered, each differing in format and in the method used to define the target pathology class. We tested AutoML models based on linguistic features, several variations of encoder-based Transformers such as BERT, and state-of-the-art LLMs as pathology classification models. The results demonstrated that LLMs outperform traditional methods, particularly on noisy and small datasets where training examples vary significantly in text length and genre. However, psycholinguistic features and encoder-based models can achieve performance comparable to language models when trained on texts from individuals with clinically confirmed depression, highlighting their potential effectiveness in targeted clinical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑