arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2411.15076eess.IVcs.CVq-bio.QM

RankByGene: 通过跨模态排序一致性实现基因引导的组织病理学表示学习

RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency

Stony Brook University(石英溪大学);Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School(阿提诺拉A.马丁努斯生物医学影像中心,麻省总医院和哈佛医学院);Department of Biomedical Data Science, Stanford University(生物医学数据科学系,斯坦福大学);Department of Pathology and Cell Biology, Columbia University(病理学与细胞生物学系,哥伦比亚大学)

Wentao Huang, Meilong Xu, Xiaoling Hu, Shahira Abousamra, Aniruddha Ganguly, Saarthak Kapse, Alisa Yurovsky, Prateek Prasanna, Tahsin Kurc, Joel Saltz, Michael L. Miller, Chao Chen

AI总结:

提出基于排序对齐损失的框架,利用教师-学生网络自监督知识蒸馏,解决空间转录组学与组织学图像的对齐问题,在基因表达预测、切片分类和生存分析任务中表现优异。

摘要:

空间转录组学通过映射组织内的基因表达提供必要的空间背景,从而能够详细研究细胞异质性和组织组织。然而,由于固有的空间扭曲和模态特异性变化,将ST数据与组织学图像对齐面临挑战。现有方法主要依赖直接对齐,通常无法捕捉复杂的跨模态关系。为解决这些限制,我们提出一种新颖框架,使用基于排序的对齐损失来对齐基因和图像特征,保留跨模态的相对相似性,并实现稳健的多尺度对齐。为进一步增强对齐的稳定性,我们采用教师-学生网络架构的自监督知识蒸馏,有效减轻基因表达数据中高维性、稀疏性和噪声带来的干扰。在涵盖基因表达预测、切片级分类和生存分析的七个公共数据集上的大量实验证明了我们方法的有效性,显示出比现有方法更好的对齐和预测性能。

英文摘要:

Spatial transcriptomics (ST) provides essential spatial context by mapping gene expression within tissue, enabling detailed study of cellular heterogeneity and tissue organization. However, aligning ST data with histology images poses challenges due to inherent spatial distortions and modality-specific variations. Existing methods largely rely on direct alignment, which often fails to capture complex cross-modal relationships. To address these limitations, we propose a novel framework that aligns gene and image features using a ranking-based alignment loss, preserving relative similarity across modalities and enabling robust multi-scale alignment. To further enhance the alignment's stability, we employ self-supervised knowledge distillation with a teacher-student network architecture, which serves as an intra-modal stability regularizer that prevents image-representation drift during cross-modal alignment. Extensive experiments on seven public datasets that encompass gene expression prediction, slide-level classification, and survival analysis demonstrate the efficacy of our method, showing improved alignment and predictive performance over existing methods. Code is available at https://github.com/winston52/RankByGene.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑