arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.14277cs.CV
收藏

基于补丁的直观多模态原型网络(PIMPNet)用于阿尔茨海默病分类

Patch-based Intuitive Multimodal Prototypes Network (PIMPNet) for Alzheimer's Disease classification

University of Pisa(比萨大学);University of Marburg(马尔堡大学);University of Mannheim(曼海姆大学);Datacation

Lisa Anita De Santi, Jörg Schlötterer, Meike Nauta, Vincenzo Positano, Christin Seifert

AI总结:

提出PIMPNet,首个可解释的多模态原型网络,结合3D sMRI与年龄进行阿尔茨海默病二分类,尽管年龄原型未提升性能,但为未来多模态原型设计奠定基础。

摘要:

结构磁共振成像(sMRI)等体积神经影像检查通常用于支持对阿尔茨海默病(AD)等痴呆症的临床诊断。神经放射科医生通过检查三维sMRI来检测和监测由AD引起的脑形态异常,如整体和/或局部脑萎缩以及特征结构的形状改变。目前,基于深度学习(DL)模型开发用于分析sMRI以诊断AD的诊断系统具有强烈的研究兴趣。然而,从sMRI检查中提取的解剖信息需要与患者的年龄一起解读,以区分AD模式与正常衰老过程中产生的常规变化。在此背景下,部分原型神经网络将DL的计算优势集成到可解释的设计架构中,并在医学影像应用中显示出有前景的结果。我们提出了PIMPNet,这是首个应用于从三维sMRI和患者年龄进行AD二分类的可解释多模态模型,用于三维图像和人口统计学数据。尽管与单模态模型相比,年龄原型并未提高预测性能,但这为未来在模型设计和多模态原型训练过程方向上的工作奠定了基础。

英文摘要:

Volumetric neuroimaging examinations like structural Magnetic Resonance Imaging (sMRI) are routinely applied to support the clinical diagnosis of dementia like Alzheimer's Disease (AD). Neuroradiologists examine 3D sMRI to detect and monitor abnormalities in brain morphology due to AD, like global and/or local brain atrophy and shape alteration of characteristic structures. There is a strong research interest in developing diagnostic systems based on Deep Learning (DL) models to analyse sMRI for AD. However, anatomical information extracted from an sMRI examination needs to be interpreted together with patient's age to distinguish AD patterns from the regular alteration due to a normal ageing process. In this context, part-prototype neural networks integrate the computational advantages of DL in an interpretable-by-design architecture and showed promising results in medical imaging applications. We present PIMPNet, the first interpretable multimodal model for 3D images and demographics applied to the binary classification of AD from 3D sMRI and patient's age. Despite age prototypes do not improve predictive performance compared to the single modality model, this lays the foundation for future work in the direction of the model's design and multimodal prototype training process

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑