arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.02145cs.LGcs.AI
收藏

一种用于癌症生存风险预测的多模态对象级对比学习方法

A Multimodal Object-level Contrast Learning Method for Cancer Survival Risk Prediction

Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学)

Zekang Yang, Hong Liu, Xiangdong Wang

AI总结:

本文提出多模态对象级对比学习方法,利用样本间生存风险关系构建对比学习对,并结合注意力与自归一化网络融合病理图像和基因组数据,在两个公开数据集上取得优于现有方法的癌症生存风险预测性能。

摘要:

计算机辅助的癌症生存风险预测在患者的及时治疗中发挥着重要作用。这是一个具有挑战性的弱监督有序回归任务,涉及病理图像、基因组数据等多种临床因素。本文提出了一种新的训练方法,即多模态对象级对比学习,用于癌症生存风险预测。首先,我们基于训练样本集中样本之间的生存风险关系构建对比学习对。然后,我们引入对象级对比学习方法来训练生存风险预测器。我们进一步通过应用跨模态对比将其扩展到多模态场景。考虑到病理图像和基因组数据的异质性,我们分别采用基于注意力的神经网络和基于自归一化的神经网络构建了一个多模态生存风险预测器。最后,在两个公开的多模态癌症数据集上,我们提出的方法训练的生存风险预测器在生存风险预测方面优于最先进的方法。

英文摘要:

Computer-aided cancer survival risk prediction plays an important role in the timely treatment of patients. This is a challenging weakly supervised ordinal regression task associated with multiple clinical factors involved such as pathological images, genomic data and etc. In this paper, we propose a new training method, multimodal object-level contrast learning, for cancer survival risk prediction. First, we construct contrast learning pairs based on the survival risk relationship among the samples in the training sample set. Then we introduce the object-level contrast learning method to train the survival risk predictor. We further extend it to the multimodal scenario by applying cross-modal constrast. Considering the heterogeneity of pathological images and genomics data, we construct a multimodal survival risk predictor employing attention-based and self-normalizing based nerural network respectively. Finally, the survival risk predictor trained by our proposed method outperforms state-of-the-art methods on two public multimodal cancer datasets for survival risk prediction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑