arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.07746cs.CV

基于可解释状态空间模型的3D高分辨率MR图像脑肿瘤表征学习

Learning Brain Tumor Representation in 3D High-Resolution MR Images via Interpretable State Space Models

Stony Brook University(石溪大学);University of Rochester(罗切斯特大学);Technical University of Munich(慕尼黑工业大学);Southern University of Science and Technology(南方科技大学);Harvard Medical School(哈佛医学院)

Qingqiao Hu, Daoan Zhang, Jiebo Luo, Zhenyu Gong, Benedikt Wiestler, Jianguo Zhang, Hongwei Bran Li

AI总结:

针对3D高分辨率MR图像表征学习中ViT计算复杂、可解释性弱的问题,提出基于SSM的掩码自编码器及潜空间到空间映射技术,在两项脑肿瘤分类任务上达SOTA,兼具效率与可解释性。

摘要:

从高维容积磁共振(MR)图像中学习有意义且可解释的表征,对推进个性化医疗至关重要。尽管Vision Transformers(ViTs,视觉Transformer)在处理图像数据方面展现出潜力,但受限于计算复杂度与可解释性问题,其在3D多对比度MR图像上的应用仍面临挑战。针对这一问题,我们提出一种新型基于状态空间模型(SSM)的掩码自编码器,可扩展类ViT模型以高效处理高分辨率数据,同时增强所学表征的可解释性。我们提出一种潜空间到空间的映射技术,能够在SSM框架下直接可视化潜特征与输入容积中特定区域的对应关系。我们在两项核心神经肿瘤学任务上验证了方法:异柠檬酸脱氢酶突变状态识别与1p/19q共缺失分类,均取得了当前最优准确率。研究结果表明,基于SSM的自监督学习兼具效率与可解释性,有望革新影像组学分析。

英文摘要:

Learning meaningful and interpretable representations from high-dimensional volumetric magnetic resonance (MR) images is essential for advancing personalized medicine. While Vision Transformers (ViTs) have shown promise in handling image data, their application to 3D multi-contrast MR images faces challenges due to computational complexity and interpretability. To address this, we propose a novel state-space-model (SSM)-based masked autoencoder which scales ViT-like models to handle high-resolution data effectively while also enhancing the interpretability of learned representations. We propose a latent-to-spatial mapping technique that enables direct visualization of how latent features correspond to specific regions in the input volumes in the context of SSM. We validate our method on two key neuro-oncology tasks: identification of isocitrate dehydrogenase mutation status and 1p/19q co-deletion classification, achieving state-of-the-art accuracy. Our results highlight the potential of SSM-based self-supervised learning to transform radiomics analysis by combining efficiency and interpretability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑