抑郁与创伤后应激障碍的三模态严重度融合诊断
Tri-Modal Severity Fused Diagnosis across Depression and Post-traumatic Stress Disorders
AI总结:
针对抑郁和PTSD共病,提出三模态情感严重度融合框架,同步文本、音频和面部特征,输出分级诊断,优于单模态基线并提升鲁棒性。
摘要:
抑郁症和创伤后应激障碍(PTSD)常伴随出现,症状相互关联,使得自动化评估复杂化,而现有评估通常是二分类且针对单一疾病。临床上有用的诊断需要严重度感知的跨疾病估计和决策支持解释。我们的统一三模态情感严重度框架将访谈文本与句子级Transformer嵌入、音频与带增量的对数梅尔统计特征、面部信号与动作单元、注视、头部和姿态描述符进行同步和融合,输出分级严重度,用于诊断抑郁症(PHQ-8;5类)和PTSD(3类)。标准化特征通过校准的晚期融合分类器进行融合,生成每种疾病的概率和特征级归因。这种严重度感知的三模态情感融合方法在并发抑郁症和PTSD评估的多疾病场景中进行了演示。在DAIC衍生语料库上的分层交叉验证优于单模态/消融基线。融合模型在准确率和加权F1上匹配最强单模态基线,同时在噪声或缺失模态下改善了决策曲线效用和鲁棒性。具体而言,对于PTSD,融合减少了回归误差并改善了类别一致性。错误集中在相邻严重度之间;极端类别被可靠识别。消融实验表明,文本对抑郁症严重度贡献最大,音频和面部线索对PTSD至关重要,而归因与语言和行为标记一致。我们的方法为情感临床决策提供了可复现的评估和临床医生在环支持。
英文摘要:
Depression and post traumatic stress disorder (PTSD) often co-occur with connected symptoms, complicating automated assessment, which is often binary and disorder specific. Clinically useful diagnosis needs severity aware cross disorder estimates and decision support explanations. Our unified tri modal affective severity framework synchronizes and fuses interview text with sentence level transformer embeddings, audio with log Mel statistics with deltas, and facial signals with action units, gaze, head and pose descriptors to output graded severities for diagnosing both depression (PHQ-8; 5 classes) and PTSD (3 classes). Standardized features are fused via a calibrated late fusion classifier, yielding per disorder probabilities and feature-level attributions. This severity aware tri-modal affective fusion approach is demoed on multi disorder concurrent depression and PTSD assessment. Stratified cross validation on DAIC derived corpora outperforms unimodal/ablation baselines. The fused model matches the strongest unimodal baseline on accuracy and weighted F1, while improving decision curve utility and robustness under noisy or missing modalities. For PTSD specifically, fusion reduces regression error and improves class concordance. Errors cluster between adjacent severities; extreme classes are identified reliably. Ablations show text contributes most to depression severity, audio and facial cues are critical for PTSD, whereas attributions align with linguistic and behavioral markers. Our approach offers reproducible evaluation and clinician in the loop support for affective clinical decision making.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。