arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.11644cs.CVcs.AI
收藏

IDRL: 一种面向抑郁症诊断的个体感知多模态抑郁症相关表示学习框架

IDRL: An Individual-Aware Multimodal Depression-Related Representation Learning Framework for Depression Diagnosis

School of Computer Science and Engineering, Northeastern University, Shenyang, China(东北大学计算机科学与工程学院);Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, China(教育部医学图像智能计算重点实验室);National Frontiers Science Center for Industrial Intelligence and Systems Optimization, Shenyang, China(工业智能与系统优化国家级前沿科学中心);Alberta Machine Intelligence Institute, University of Alberta, Edmonton, Canada(阿尔伯塔机器智能研究所,阿尔伯塔大学,加拿大爱德蒙顿)

Chongxiao Wang, Junjie Liang, Peng Cao, Jinzhu Yang, Osmar R. Zaiane

AI总结:

IDRL框架通过分解多模态表示并引入个体感知的模态融合模块,提升抑郁症诊断的鲁棒性和适应性。

摘要:

抑郁症是一种严重的心理障碍,可靠的识别在早期干预和治疗中起着关键作用。多模态抑郁症检测旨在通过联合建模多种模态的互补信息来提高诊断性能。最近,已提出多种多模态学习方法用于抑郁症分析;然而,这些方法存在以下局限性:1)模态间不一致性和与抑郁症无关的干扰,其中抑郁症相关线索可能在不同模态间冲突,而大量无关内容会掩盖关键的抑郁信号;2)多样化的个体抑郁症表现,导致模态和线索重要性存在个体差异,从而阻碍可靠的融合。为了解决这些问题,我们提出了Individual-aware Multimodal Depression-related Representation Learning Framework(IDRL)用于稳健的抑郁症诊断。具体而言,IDRL 1)将多模态表示分解为一个模态通用的抑郁症空间、一个模态特定的抑郁症空间和一个与抑郁症无关的空间,以增强模态对齐并抑制无关信息;2)引入一个个体感知的模态融合模块(IAF),该模块根据其预测重要性动态调整分解的抑郁症相关特征的权重,从而实现适应不同个体的跨模态融合。大量实验表明,IDRL在多模态抑郁症检测中实现了优越且稳健的性能。

英文摘要:

Depression is a severe mental disorder, and reliable identification plays a critical role in early intervention and treatment. Multimodal depression detection aims to improve diagnostic performance by jointly modeling complementary information from multiple modalities. Recently, numerous multimodal learning approaches have been proposed for depression analysis; however, these methods suffer from the following limitations: 1) inter-modal inconsistency and depression-unrelated interference, where depression-related cues may conflict across modalities while substantial irrelevant content obscures critical depressive signals, and 2) diverse individual depressive presentations, leading to individual differences in modality and cue importance that hinder reliable fusion. To address these issues, we propose Individual-aware Multimodal Depression-related Representation Learning Framework (IDRL) for robust depression diagnosis. Specifically, IDRL 1) disentangles multimodal representations into a modality-common depression space, a modality-specific depression space, and a depression-unrelated space to enhance modality alignment while suppressing irrelevant information, and 2) introduces an individual-aware modality-fusion module (IAF) that dynamically adjusts the weights of disentangled depression-related features based on their predictive significance, thereby achieving adaptive cross-modal fusion for different individuals. Extensive experiments demonstrate that IDRL achieves superior and robust performance for multimodal depression detection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑