arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.03388cs.LGcs.AI
收藏

多模态多核图学习用于自闭症预测与生物标志物发现

Multi-modal Multi-kernel Graph Learning for Autism Prediction and Biomarker Discovery

Central South University(中南大学);Xinjiang University(新疆大学);Shenzhen University of Advanced Technology(深圳先进技术研究院?不,正确翻译:深圳理工大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Dundee(邓迪大学);Griffith University(格里菲斯大学);Shenzhen Health Development Research and Data Management Center(深圳卫生发展研究与数据管理中心)

Jin Liu, Junbin Mao, Hanhe Lin, Hulin Kuang, Shirui Pan, Xusheng Wu, Shan Xie, Fei Liu, Yi Pan

AI总结:

针对疾病预测中基于图学习的多模态整合与分类挑战,提出MMKGL方法,通过自适应学习生成各模态图并引入优化图,结合多核聚合提取信息,在ABIDE数据集上性能更优且识别出相关脑区。

摘要:

由于其复杂性,基于图学习的多模态整合与分类是疾病预测中最具挑战性的障碍之一。为了有效抵消多模态整合过程中模态间的负面影响,并从图中提取异质信息,我们提出了一种名为MMKGL(多模态多核图学习)的新方法。针对模态间的负面影响问题,我们提出了一个多模态图嵌入模块来构建多模态图。与为所有模态手动构建静态图的传统方法不同,每个模态通过自适应学习生成单独的图,其中在多图融合嵌入过程中引入函数图和监督图进行优化。然后,我们提出一个多核图学习模块,从多模态图中提取异质信息。多模态图中不同层次的信息通过不同感受野大小的卷积核进行聚合,随后生成跨核发现张量用于疾病预测。我们的方法在基准数据集Autism Brain Imaging Data Exchange(ABIDE)上进行了评估,性能优于当前最先进的方法。此外,我们的模型识别出与自闭症相关的具有鉴别性的脑区,为自闭症病理学研究提供了指导。

英文摘要:

Due to its complexity, graph learning-based multi-modal integration and classification is one of the most challenging obstacles for disease prediction. To effectively offset the negative impact between modalities in the process of multi-modal integration and extract heterogeneous information from graphs, we propose a novel method called MMKGL (Multi-modal Multi-Kernel Graph Learning). For the problem of negative impact between modalities, we propose a multi-modal graph embedding module to construct a multi-modal graph. Different from conventional methods that manually construct static graphs for all modalities, each modality generates a separate graph by adaptive learning, where a function graph and a supervision graph are introduced for optimization during the multi-graph fusion embedding process. We then propose a multi-kernel graph learning module to extract heterogeneous information from the multi-modal graph. The information in the multi-modal graph at different levels is aggregated by convolutional kernels with different receptive field sizes, followed by generating a cross-kernel discovery tensor for disease prediction. Our method is evaluated on the benchmark Autism Brain Imaging Data Exchange (ABIDE) dataset and outperforms the state-of-the-art methods. In addition, discriminative brain regions associated with autism are identified by our model, providing guidance for the study of autism pathology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑