The utilization of automated depression detection significantly enhances early intervention for individuals experiencing depression. Despite numerous proposals on automated depression detection using recorded clinical interview videos, limited attention has been paid to considering the hierarchical structure of the interview questions. In clinical interviews for diagnosing depression, clinicians use a structured questionnaire that includes routine baseline questions and follow-up questions to assess the interviewee's condition. This paper introduces HiQuE (Hierarchical Question Embedding network), a novel depression detection framework that leverages the hierarchical relationship between primary and follow-up questions in clinical interviews. HiQuE can effectively capture the importance of each question in diagnosing depression by learning mutual information across multiple modalities. We conduct extensive experiments on the widely-used clinical interview data, DAIC-WOZ, where our model outperforms other state-of-the-art multimodal depression detection models and emotion recognition models, showcasing its clinical utility in depression detection.
IDRL: An Individual-Aware Multimodal Depression-Related Representation Learning Framework for Depression Diagnosis
School of Computer Science and Engineering, Northeastern University, Shenyang, China(东北大学计算机科学与工程学院);Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, China(教育部医学图像智能计算重点实验室);National Frontiers Science Center for Industrial Intelligence and Systems Optimization, Shenyang, China(工业智能与系统优化国家级前沿科学中心);Alberta Machine Intelligence Institute, University of Alberta, Edmonton, Canada(阿尔伯塔机器智能研究所,阿尔伯塔大学,加拿大爱德蒙顿)
MLlm-DR: Towards Explainable Depression Recognition with MultiModal Large Language Models
National University of Defense Technology(国防科技大学);University of Chinese Academy of Sciences(中国科学院大学);Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine(上海精神卫生中心,上海交通大学医学院);Nanjing Industria Tenebris Information Technology Co., Ltd.(南京Industria Tenebris信息技术有限公司);National University of Uzbekistan named after Mirzo Ulugbek(乌兹别克斯坦Mirzo Ulugbek命名的国立大学)
The First MPDD Challenge: Multimodal Personality-aware Depression Detection
Northeastern University(东北大学);University of Technology Sydney(悉尼大学);Xiamen University(厦门大学);Technical University of Munich(慕尼黑技术大学);University of Cambridge(剑桥大学);National Information Institute(国家信息研究所);Osaka University(大阪大学);Imperial College London(伦敦帝国理工学院)
LMVD: A Large-Scale Multimodal Vlog Dataset for Depression Detection in the Wild
Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing(陕西省网络数据分析与智能处理重点实验室);College of Electronic Information and Artificial Intelligence, Shaanxi University of Science and Technology(陕西科技大学电子信息与人工智能学院);Institute of Intelligent Information Processing, Taizhou University(台州学院智能信息处理研究所)
MERID: Multimodal Exploration via Recursive Self-Improvement Agents for Major Depression Analysis
Yale University(耶鲁大学);Zhejiang University(浙江大学);Northwestern University(西北大学);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Tsinghua University(清华大学);Stevens Institute of Technology(史蒂文斯理工学院)
Dynamic Summary Generation for Interpretable Multimodal Depression Detection
College of Information Science and Engineering, Ritsumeikan University(立命馆大学信息科学与工程学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Faculty of Engineering, University of the Ryukyus(琉球大学工学部)
MMFformer: Multimodal Fusion Transformer Network for Depression Detection
Centre for Pattern Analysis and Machine Intelligence, Department of Electrical and Computer Engineering, University of Waterloo(模式分析与机器智能中心,电气与计算机工程系,滑铁卢大学);School of Engineering and Computing, Department of Computer Science and Engineering, American University of Ras Al Khaimah(工程与计算学院,计算机科学与工程系,阿联酋拉线哈姆斯美国大学)
EviDep: Uncertainty-Aware Multimodal Depression Estimation via Disentangled Evidential Learning
School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院);School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机科学与信息工程学院);Department of Psychiatry, The First Affiliated Hospital of University of Science and Technology of China, Division of Life Sciences and Medicine, University of Science and Technology of China(中国科学技术大学附属第一医院精神科,生命科学与医学学院)
TAMI: Temporally Aligned, Missingness-Aware, and Interpretable Multimodal Fusion for Mental Health Assessment in Older Adults with Mild Cognitive Impairment
Georgia Institute of Technology(佐治亚理工学院);Emory University(埃默里大学);Cairo University(开罗大学)
Investigating Acoustic-Textual Emotional Inconsistency Information for Automatic Depression Detection
Guangdong-Hong Kong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院粤港澳人机协同智能系统联合实验室);University of Chinese Academy of Sciences(中国科学院大学);Good Mood Health Industry Group Co., Ltd(好心情健康产业集团有限公司);Shanghai Jiao Tong University(上海交通大学)
Unveiling the Landscape of Clinical Depression Assessment: From Behavioral Signatures to Psychiatric Reasoning
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);CoAI Group, DCST, IAI, BNRIST, Tsinghua University(清华大学);University of International Relations(国际关系大学);Central China Normal University(华中师范大学);Lingxin AI(灵心AI);Yuquan Hospital, Tsinghua University(清华大学友谊医院)
MF-GCN: A Multi-Frequency Graph Convolutional Network for Tri-Modal Depression Detection Using Eye-Tracking, Facial, and Acoustic Features
Department of Computer Science, New Uzbekistan University, Tashkent, Uzbekistan(计算机科学系,新乌兹别克斯坦大学);Department of Robotics and Mechatronics Engineering, University of Dhaka, Bangladesh(机器人与机电工程系,达卡大学);Department of Electrical and Computer Engineering, University of Virginia, USA(电气与计算机工程系,弗吉尼亚大学)
Harnessing LLMs for Automated Video Content Analysis: An Exploratory Workflow of Short Videos on Depression
The University of Texas at Austin(德克萨斯大学奥斯汀分校);Institute of High Performance Computing (IHPC), A*STAR(高性能计算研究所(A*STAR));Pennsylvania State University(宾夕法尼亚州立大学);Clark University(克拉克大学);Columbia University(哥伦比亚大学)