arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.03648cs.AIcs.MM
收藏

HiQuE:面向多模态抑郁症检测的层次化问题嵌入网络

HiQuE: Hierarchical Question Embedding Network for Multimodal Depression Detection

Sungkyunkwan University(成均馆大学);Raondata(伦达塔公司);University of South Florida(南佛罗里达大学)

Juho Jung, Chaewon Kang, Jeewoo Yoon, Seungbae Kim, Jinyoung Han

AI总结:

本文提出HiQuE层次化问题嵌入网络,利用临床访谈中主问题与追问的层次关系和多模态互信息提升抑郁症检测性能,在DAIC-WOZ上超越现有最优模型。

摘要:

自动化抑郁症检测的利用显著增强了对抑郁症患者的早期干预。尽管已有许多基于录制临床访谈视频的自动化抑郁症检测方案,但考虑访谈问题层次结构的研究仍十分有限。在用于诊断抑郁症的临床访谈中,临床医生使用结构化问卷,包括常规基线问题和后续追问问题,以评估受访者的状况。本文提出HiQuE(层次化问题嵌入网络),这是一种新颖的抑郁症检测框架,利用临床访谈中主要问题与后续问题之间的层次关系。HiQuE能够通过学习多模态之间的互信息,有效捕捉每个问题在抑郁症诊断中的重要性。我们在广泛使用的临床访谈数据集DAIC-WOZ上进行了大量实验,结果表明我们的模型优于其他最先进的多模态抑郁症检测模型和情感识别模型,展示了其在抑郁症检测中的临床实用性。

英文摘要:

The utilization of automated depression detection significantly enhances early intervention for individuals experiencing depression. Despite numerous proposals on automated depression detection using recorded clinical interview videos, limited attention has been paid to considering the hierarchical structure of the interview questions. In clinical interviews for diagnosing depression, clinicians use a structured questionnaire that includes routine baseline questions and follow-up questions to assess the interviewee's condition. This paper introduces HiQuE (Hierarchical Question Embedding network), a novel depression detection framework that leverages the hierarchical relationship between primary and follow-up questions in clinical interviews. HiQuE can effectively capture the importance of each question in diagnosing depression by learning mutual information across multiple modalities. We conduct extensive experiments on the widely-used clinical interview data, DAIC-WOZ, where our model outperforms other state-of-the-art multimodal depression detection models and emotion recognition models, showcasing its clinical utility in depression detection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑