arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.06434eess.IVcs.CV

时空图神经网络建模灌注MRI

Spatiotemporal Graph Neural Network Modelling Perfusion MRI

University of Cambridge(剑桥大学);Department of Applied Mathematics and Theoretical Physics(应用数学与理论物理系);Department of Clinical Neurosciences(临床神经科学系)

Ruodan Yan, Carola-Bibiane Schönlieb, Chao Li

AI总结:

本文提出时空图神经网络模型PerfGAT,通过边注意力图结构学习、双注意力特征融合和类别平衡增强,首次对4D灌注MRI建模并预测胶质瘤IDH突变状态,性能优于现有方法。

摘要:

灌注MRI(pMRI)为肿瘤血管分布提供了有价值的见解,并有望预测肿瘤基因型,从而有利于胶质瘤患者的预后,但目前仍缺乏针对4D pMRI量身定制的有效模型。本研究首次尝试使用基于GNN的时空模型PerfGAT对4D pMRI进行建模,该模型融合空间信息和时间动力学,以预测胶质瘤患者的异柠檬酸脱氢酶(IDH)突变状态。具体而言,我们提出了一种基于边注意力和负图的图结构学习方法,以优化时间相关性建模。此外,我们设计了一个双注意力特征融合模块,在关注肿瘤相关脑区的同时整合时空特征。进一步,我们开发了一种针对时空数据的类别平衡增强方法,可以缓解临床数据集中常见的标签不平衡问题。实验结果表明,所提方法优于其他最先进的方法,有望有效建模pMRI以用于患者表征。

英文摘要:

Perfusion MRI (pMRI) offers valuable insights into tumor vascularity and promises to predict tumor genotypes, thus benefiting prognosis for glioma patients, yet effective models tailored to 4D pMRI are still lacking. This study presents the first attempt to model 4D pMRI using a GNN-based spatiotemporal model PerfGAT, integrating spatial information and temporal kinetics to predict Isocitrate DeHydrogenase (IDH) mutation status in glioma patients. Specifically, we propose a graph structure learning approach based on edge attention and negative graphs to optimize temporal correlations modeling. Moreover, we design a dual-attention feature fusion module to integrate spatiotemporal features while addressing tumor-related brain regions. Further, we develop a class-balanced augmentation methods tailored to spatiotemporal data, which could mitigate the common label imbalance issue in clinical datasets. Our experimental results demonstrate that the proposed method outperforms other state-of-the-art approaches, promising to model pMRI effectively for patient characterization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑