arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.03026cs.CV
收藏

ASIGN:一种用于3D空间转录组学的解剖学感知空间插补图网络

ASIGN: An Anatomy-aware Spatial Imputation Graphic Network for 3D Spatial Transcriptomics

Vanderbilt University(范德堡大学);Vanderbilt University Medical Center(范德堡大学医学中心)

Junchao Zhu, Ruining Deng, Tianyuan Yao, Juming Xiong, Chongyu Qu, Junlin Guo, Siqi Lu, Mengmeng Yin, Yu Wang, Shilin Zhao, Haichun Yang, Yuankai Huo

AI总结:

针对3D空间转录组建库成本高昂的问题,本文提出ASIGN图网络,利用3D WSI切片与单张2D ST切片插补3D ST,并在三个公开数据集上达到2D与3D场景的最优性能。

摘要:

空间转录组学(ST)是一项新兴技术,使医学计算机视觉科学家能够自动解读形态特征背后的分子谱。然而,目前大多数基于深度学习的ST分析仅限于二维(2D)切片,由于病理组织在不同3D切片间存在异质性,这可能导致诊断错误。将ST扩展到三维(3D)体数据具有挑战性,因为成本高昂;一次2D ST采集的成本已经是全切片成像(WSI)的50倍以上,而包含10张切片的完整3D体数据成本可能高出一个数量级。为降低成本,科学家们尝试直接从WSI预测ST数据,而不进行实际的ST采集。然而,这些方法通常产生不理想的结果。为解决这一问题,我们引入了一种新的问题设定:利用3D WSI组织学切片结合单张2D ST切片进行3D ST插补。为此,我们提出了解剖学感知空间插补图网络(ASIGN),用于更精确且经济可承受的3D ST建模。ASIGN架构通过利用跨层重叠和基于相似性的扩展,将现有的2D空间关系扩展到3D。此外,一个多级空间注意力图网络全面整合了不同数据源的特征。我们在三个公开的空间转录组学数据集上评估了ASIGN,实验结果表明,ASIGN在2D和3D场景中均达到了最先进性能。代码可在https://github.com/hrlblab/ASIGN获取。

英文摘要:

Spatial transcriptomics (ST) is an emerging technology that enables medical computer vision scientists to automatically interpret the molecular profiles underlying morphological features. Currently, however, most deep learning-based ST analyses are limited to two-dimensional (2D) sections, which can introduce diagnostic errors due to the heterogeneity of pathological tissues across 3D sections. Expanding ST to three-dimensional (3D) volumes is challenging due to the prohibitive costs; a 2D ST acquisition already costs over 50 times more than whole slide imaging (WSI), and a full 3D volume with 10 sections can be an order of magnitude more expensive. To reduce costs, scientists have attempted to predict ST data directly from WSI without performing actual ST acquisition. However, these methods typically yield unsatisfying results. To address this, we introduce a novel problem setting: 3D ST imputation using 3D WSI histology sections combined with a single 2D ST slide. To do so, we present the Anatomy-aware Spatial Imputation Graph Network (ASIGN) for more precise, yet affordable, 3D ST modeling. The ASIGN architecture extends existing 2D spatial relationships into 3D by leveraging cross-layer overlap and similarity-based expansion. Moreover, a multi-level spatial attention graph network integrates features comprehensively across different data sources. We evaluated ASIGN on three public spatial transcriptomics datasets, with experimental results demonstrating that ASIGN achieves state-of-the-art performance on both 2D and 3D scenarios. Code is available at https://github.com/hrlblab/ASIGN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑