arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.17758eess.IVcs.CV

胶质瘤多模态MRI分析系统:基于多任务半监督学习的肿瘤分层诊断

Glioma Multimodal MRI Analysis System for Tumor Layered Diagnosis via Multi-task Semi-supervised Learning

Cancer Research Institute, Central South University(中南大学肿瘤研究所);School of Physics & Electronic Science, Changsha University of Science & Technology(长沙理工大学物理与电子科学学院);IFLYTEK Research(iFlytek研究院);School of Life Sciences, Central South University(中南大学生命科学学院);Department of Radiology, Xiangya Hospital, Central South University(中南大学湘雅医院放射科);School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Department of Neurosurgery, Xiangya Hospital, Central South University(中南大学湘雅医院神经外科)

Yihao Liu, Zhihao Cui, Liming Li, Junjie You, Xinle Feng, Jianxin Wang, Xiangyu Wang, Qing Liu, Minghua Wu

AI总结:

提出GMMAS系统,利用多任务半监督学习同时完成胶质瘤分割、分级、IDH和1p/19q状态预测,提升诊断精度并增强模态缺失鲁棒性,辅助临床决策。

摘要:

胶质瘤是中枢神经系统最常见的原发性肿瘤。多模态MRI广泛用于胶质瘤的初步筛查,并在辅助诊断、疗效评估和预后评价中发挥关键作用。目前,基于MRI的胶质瘤计算机辅助诊断研究主要集中于独立分析任务,如肿瘤分割、分级和放射基因组学分类,而未研究这些任务之间的相互依赖关系。在本研究中,我们提出了一种胶质瘤多模态MRI分析系统(GMMAS),该系统利用深度学习网络同时处理多个任务,通过基于不确定性的多任务学习架构利用任务间的相互依赖关系,并同步输出肿瘤区域分割、胶质瘤组织学亚型、IDH突变基因型和1p/19q染色体缺失状态。与已报道的单任务分析模型相比,GMMAS在肿瘤分层诊断任务中提高了精度。此外,我们采用了两阶段半监督学习方法,通过充分利用标记和未标记的MRI样本增强模型性能。进一步,通过利用基于知识自蒸馏和对比学习的适应模块进行跨模态特征提取,GMMAS在模态缺失情况下表现出鲁棒性,并揭示了各MRI模态的不同重要性。最后,基于GMMAS的分析输出,我们为医生和患者创建了一个可视化且用户友好的平台,引入GMMAS-GPT生成个性化预后评估和建议。

英文摘要:

Gliomas are the most common primary tumors of the central nervous system. Multimodal MRI is widely used for the preliminary screening of gliomas and plays a crucial role in auxiliary diagnosis, therapeutic efficacy, and prognostic evaluation. Currently, the computer-aided diagnostic studies of gliomas using MRI have focused on independent analysis events such as tumor segmentation, grading, and radiogenomic classification, without studying inter-dependencies among these events. In this study, we propose a Glioma Multimodal MRI Analysis System (GMMAS) that utilizes a deep learning network for processing multiple events simultaneously, leveraging their inter-dependencies through an uncertainty-based multi-task learning architecture and synchronously outputting tumor region segmentation, glioma histological subtype, IDH mutation genotype, and 1p/19q chromosome disorder status. Compared with the reported single-task analysis models, GMMAS improves the precision across tumor layered diagnostic tasks. Additionally, we have employed a two-stage semi-supervised learning method, enhancing model performance by fully exploiting both labeled and unlabeled MRI samples. Further, by utilizing an adaptation module based on knowledge self-distillation and contrastive learning for cross-modal feature extraction, GMMAS exhibited robustness in situations of modality absence and revealed the differing significance of each MRI modal. Finally, based on the analysis outputs of the GMMAS, we created a visual and user-friendly platform for doctors and patients, introducing GMMAS-GPT to generate personalized prognosis evaluations and suggestions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑