arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.16201cs.SDcs.HCeess.AS
收藏

AudVowelConsNet:一个基于音素层次的深度CNN结构用于抑郁症的临床诊断

AudVowelConsNet: A Phoneme-Level Based Deep CNN Architecture for Clinical Depression Diagnosis

University of Luxembourg(卢森堡大学);Sorbonne Universite(索邦大学)

Muhammad Muzammel, Hanan Salam, Yann Hoffmann, Mohamed Chetouani, Alice Othmani

摘要:

抑郁症是一种常见且严重的情绪障碍,对患者在日常工作中正常运作的能力产生负面影响。言语被证明是诊断抑郁症的有力工具。精神病学的研究集中在对导致言语抑郁表现的词级言语成分进行细粒度分析,并揭示了抑郁言语中音素水平的显着变化。另一方面,基于机器学习的从语音中自动识别抑郁症的研究集中于探索用于检测抑郁症及其严重程度的各种声学特征。很少有人专注于将音素级的语音成分在自动评估系统。在本文中,我们提出了一个基于人工智能(AI)的应用程序,从语音的临床抑郁症识别和评估。我们通过深度学习研究了音素单元的声学特征,特别是用于抑郁症识别的元音和辅音。我们提出并比较了三种基于频谱图的深度神经网络架构,分别对音素辅音和元音单元及其融合进行训练。我们的实验表明,深学习辅音的声学特征导致更好的识别结果比元音。通过深度网络融合元音和辅音语音特征的性能明显优于单空间网络以及DAIC-WOZ数据库上最先进的深度学习方法。

英文摘要:

Depression is a common and serious mood disorder that negatively affects the patient's capacity of functioning normally in daily tasks. Speech is proven to be a vigorous tool in depression diagnosis. Research in psychiatry concentrated on performing fine-grained analysis on word-level speech components contributing to the manifestation of depression in speech and revealed significant variations at the phoneme-level in depressed speech. On the other hand, research in Machine Learning-based automatic recognition of depression from speech focused on the exploration of various acoustic features for the detection of depression and its severity level. Few have focused on incorporating phoneme-level speech components in automatic assessment systems. In this paper, we propose an Artificial Intelligence (AI) based application for clinical depression recognition and assessment from speech. We investigate the acoustic characteristics of phoneme units, specifically vowels and consonants for depression recognition via Deep Learning. We present and compare three spectrogram-based Deep Neural Network architectures, trained on phoneme consonant and vowel units and their fusion respectively. Our experiments show that the deep learned consonant-based acoustic characteristics lead to better recognition results than vowel-based ones. The fusion of vowel and consonant speech characteristics through a deep network significantly outperforms the single space networks as well as the state-of-art deep learning approaches on the DAIC-WOZ database.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑