Mental-Perceiver:用于评估心理障碍的音频-文本多模态学习
Mental-Perceiver: Audio-Textual Multi-Modal Learning for Estimating Mental Disorders
AI总结:
针对心理障碍检测缺乏公开大规模数据集的问题,该研究构建了多模态心理评估语料库MMPsy,并提出深度学习模型Mental-Perceiver,通过音频和文本数据有效实现了焦虑与抑郁的评估。
摘要:
焦虑和抑郁等心理障碍已成为影响各年龄段人群的全球性问题。早期发现和治疗对于减轻这些障碍对日常生活的负面影响至关重要。尽管基于人工智能的检测方法显示出潜力,但缺乏公开可用的大规模数据集阻碍了进展。为解决此问题,我们引入了多模态心理评估语料库(MMPsy),这是一个大规模数据集,包含接受自动化焦虑/抑郁评估访谈的普通话青少年受访者的录音和文字记录。MMPsy还包含使用标准化心理问卷进行的自我报告焦虑/抑郁评估。利用该数据集,我们提出了Mental-Perceiver,一种从音频和文本数据评估心理障碍的深度学习模型。在MMPsy和DAIC-WOZ数据集上的大量实验证明了Mental-Perceiver在焦虑和抑郁检测中的有效性。
英文摘要:
Mental disorders, such as anxiety and depression, have become a global concern that affects people of all ages. Early detection and treatment are crucial to mitigate the negative effects these disorders can have on daily life. Although AI-based detection methods show promise, progress is hindered by the lack of publicly available large-scale datasets. To address this, we introduce the Multi-Modal Psychological assessment corpus (MMPsy), a large-scale dataset containing audio recordings and transcripts from Mandarin-speaking adolescents undergoing automated anxiety/depression assessment interviews. MMPsy also includes self-reported anxiety/depression evaluations using standardized psychological questionnaires. Leveraging this dataset, we propose Mental-Perceiver, a deep learning model for estimating mental disorders from audio and textual data. Extensive experiments on MMPsy and the DAIC-WOZ dataset demonstrate the effectiveness of Mental-Perceiver in anxiety and depression detection.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。