Spatial Transcriptomics as Images for Large-Scale Pretraining
Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);Hangzhou Institute for Advanced Study, University of the Chinese Academy of Sciences(中国科学院大学杭州高等研究院)
Spatial Transcriptomics (ST) profiles thousands of gene expression values at discrete spots with precise coordinates on tissue sections, preserving spatial context essential for clinical and pathological studies. With rising sequencing throughput and advancing platforms, the expanding data volumes motivate large-scale ST pretraining. However, the fundamental unit for pretraining, i.e., what constitutes a single training sample, remains ill-posed. Existing choices fall into two camps: (1) treating each spot as an independent sample, which discards spatial dependencies and collapses ST into single-cell transcriptomics; and (2) treating an entire slide as a single sample, which produces prohibitively large inputs and drastically fewer training examples, undermining effective pretraining. To address this gap, we propose treating spatial transcriptomics as croppable images. Specifically, we define a multi-channel image representation with fixed spatial size by cropping patches from raw slides, thereby preserving spatial context while substantially increasing the number of training samples. Along the channel dimension, we define gene subset selection rules to control input dimensionality and improve pretraining stability. Extensive experiments show that the proposed image-like dataset construction for ST pretraining consistently improves downstream performance, outperforming conventional pretraining schemes. Ablation studies verify that both spatial patching and channel design are necessary, establishing a unified, practical paradigm for organizing ST data and enabling large-scale pretraining.
MagNet: Multi-Level Attention Graph Network for Predicting High-Resolution Spatial Transcriptomics
Vanderbilt University(范德堡大学);Weill Cornell Medicine(威尔康奈尔医学院);NVIDIA(英伟达公司);Vanderbilt University Medical Center(范德堡大学医学中心);UT MD Anderson Cancer Center(得克萨斯大学 MD 安德森癌症中心)
Multi-Slice Spatial Transcriptomics Data Integration Analysis with STG3Net
School of Information Science and Engineering, Yunnan University(云南大学信息科学与工程学院);College of Nursing Health Sciences, Yunnan Open University(云南开放大学护理健康学院)
HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysis
Mass General Brigham(麻省总医院布里格姆医疗系统);Harvard Medical School(哈佛医学院);ETH Zurich(苏黎世联邦理工学院);MIT(麻省理工学院);HST MIT(麻省理工学院卫生科学与技术部);TUM(慕尼黑工业大学);Helmholtz Munich(慕尼黑亥姆霍兹中心);Emory School of Medicine(埃默里医学院);Pusan National University(釜山国立大学)
Learning Relative Gene Expression Trends from Pathology Images in Spatial Transcriptomics
Laboratory of Computational Life Science, National Cancer Center Japan(国立癌症中心日本计算生命科学实验室);Department of Advanced Information Technology, Kyushu University(九州大学先进信息技术系)
Fusing Pixels and Genes: Spatially-Aware Learning in Computational Pathology
College of Intelligent Robotics and Advanced Manufacturing, Fudan University(复旦大学智能机器人与先进制造学院);Fysics Intelligence Technologies Co., Ltd. (Fysics AI)(菲茨斯智能科技有限公司(菲茨斯AI));Department of Biomedical Informatics, Harvard Medical School(哈佛医学院生物医学信息学系);Tencent Youtu Lab(腾讯优图实验室);ByteDance(字节跳动)
MAD: Microenvironment-Aware Distillation -- A Pretraining Strategy for Virtual Spatial Omics from Microscopy
Research Laboratory of Electronics, Massachusetts Institute of Technology(麻省理工学院电子研究实验室);Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology(麻省理工学院电气工程与计算机科学系);The Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology(佐治亚理工学院Wallace H. Coulter生物医学工程系);H. Milton Stewart School of Industrial & Systems Engineering, Georgia Institute of Technology(佐治亚理工学院H. Milton Stewart工业与系统工程学院)
Adaptive Spatial Transcriptomics Interpolation via Cross-modal Cross-slice Modeling
School of Science and Engineering, University of Dundee, UK(邓迪大学科学与工程学院);College of Medicine and Biological Information Engineering, Northeastern University, China(东北大学医学与生物信息工程学院);Department of Clinical Neurosciences, University of Cambridge, UK(剑桥大学临床神经科学系);School of Medicine, University of Dundee, UK(邓迪大学医学院);Department of Applied Mathematics and Theoretical Physics, University of Cambridge, UK(剑桥大学应用数学与理论物理系)
Benchmarking Active Spot Selection for Cost-Efficient Spatial Transcriptomics
University of Pennsylvania(宾夕法尼亚大学);Vanderbilt University(范德堡大学);Cornell Tech(康奈尔科技校区);University of Notre Dame(圣母大学);New York Medical College(纽约医学院);Vanderbilt University Medical Center(范德堡大学医学中心);Weill Medical College of Cornell University(康奈尔大学威尔医学院)
Spatial Transcriptomics Expression Prediction from Histopathology Based on Cross-Modal Mask Reconstruction and Contrastive Learning
University of Regensburg(雷根斯堡大学);Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU)(埃尔朗根-纽伦堡弗里德里希-亚历山大大学);Beijing Friendship Hospital, Capital Medical University(首都医科大学附属北京友谊医院);Hanover Medical School(汉诺威医学院);University Clinic Freiburg(弗莱堡大学附属医院);Fraunhofer Institute for Digital Medicine MEVIS(弗劳恩霍夫数字医学研究所)
Contrastive and Adaptive Multi-modal Masked Autoencoder for Spatial Transcriptomics
Department of Artificial Intelligence, Yonsei University(延世大学人工智能系);Department of Computer Science, Yonsei University(延世大学计算机科学系);Yonsei University College of Medicine(延世大学医学院)
Sparser2Sparse: Single-shot Sparser-to-Sparse Learning for Spatial Transcriptomics Imputation with Natural Image Co-learning
Department of Radiology, Northwestern University, Chicago, IL, USA(放射科,西北大学,芝加哥,伊利诺伊州,美国);Department of Cell and Developmental Biology, Northwestern University, Chicago, IL, USA(细胞与发育生物学系,西北大学,芝加哥,伊利诺伊州,美国);Department of Pathology, Northwestern University, Chicago, IL, USA(病理学系,西北大学,芝加哥,伊利诺伊州,美国)
Integrating Pathology Foundation Models and Spatial Transcriptomics for Cellular Decomposition from Histology Images
School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA(电气与计算机工程学院,佐治亚理工学院);Department of Biomedical Engineering, Georgia Institute of Technology(生物医学工程系,佐治亚理工学院);Emory University, Atlanta, GA, USA(埃默里大学)
Segmentation-free integration of nuclei morphology and spatial transcriptomics for retinal images
Dept. of Information Technology(信息技术系);Dept. of Molecular, Cell and Developmental Biology(分子、细胞与发育生物学系);University of California, Los Angeles(加利福尼亚大学洛杉矶分校)
High-Resolution Spatial Transcriptomics from Histology Images using HisToSGE
School of Information Science and Engineering, Yunnan University(云南大学信息科学与工程学院);College of Nursing Health Sciences, Yunnan Open University(云南开放大学护理与健康科学学院)
GC-MoE: Genomics-Guided Cell-Type-Specific Mixture of Experts for Histology-Based Single-Cell Spatial Transcriptomics
Kyushu University(九州大学);German Research Center for Artificial Intelligence (DFKI GmbH)(德国人工智能研究中心);RPTU University Kaiserslautern-Landau(科布伦茨-劳恩堡大学);The University of Osaka(大阪大学);IntelligentX GmbH;Osaka Metropolitan University(大阪 Metropolitan 大学)
Imaging-anchored multiomics in cardiovascular disease: integrating cardiac imaging, bulk, single-cell, and spatial transcriptomics
International Ph.D. Program in Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan;AIBioMed Research Group, Taipei Medical University, Taipei, Taiwan;Medical Sciences Division, University of Oxford, Oxford, United Kingdom;Computational Biology Department, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA;Department of Computer Science, Emory University, Atlanta, GA, USA;Department of Chemistry, Emory University, Atlanta, GA, USA;International Master Program for Translational Science, College of Medical Science;Technology, Taipei Medical University, Taipei 110, Taiwan;In-Service Master Program in Artificial Intelligence in Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan;Translational Imaging Research Center, Taipei Medical University Hospital, Taipei, Taiwan
Global Context-aware Representation Learning for Spatially Resolved Transcriptomics
Graduate School of Data Science, KAIST, Daejeon, Republic of Korea;Department of Industrial \& Systems Engineering, KAIST, Daejeon, Republic of Korea;Department of Mathematical Sciences, KAIST, Daejeon, Republic of Korea
Spatial Transcriptomics Analysis of Zero-shot Gene Expression Prediction
Biological Data Science Institute, The Australian National University(澳大利亚国立大学生物数据科学研究所);Optus Centre for AI, Curtin University(科廷大学Optus人工智能中心);Department of Electrical and Computer Engineering, North South University(南北大学电气与计算机工程系)
Prototype-driven fusion of pathology and spatial transcriptomics for interpretable survival prediction
Department of Biostatistics, MD Anderson Cancer Center(生物统计学系,MD安德森癌症中心);Department of Translational Molecular Pathology, MD Anderson Cancer Center(转化分子病理学系,MD安德森癌症中心);The Institute for Data Science in Oncology (IDSO), MD Anderson Cancer Center(肿瘤学数据科学研究所(IDSO),MD安德森癌症中心)
Do Foundation Models See Biology? Evaluating Attention Coherence with Spatial Transcriptomics in Glioblastoma
Translational Medicine, School of Medicine, Queen’s University, Kingston, ON, Canada(转化医学、医学院、皇后大学、金斯顿,ON,加拿大);School of Computing, Queen’s University, Kingston, ON, Canada(计算学院、皇后大学、金斯顿,ON,加拿大);Department of Surgery, Queen’s University, Kingston, ON, Canada(外科部门、皇后大学、金斯顿,ON,加拿大)
Towards Spatial Transcriptomics-driven Pathology Foundation Models
Department of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA(病理学系,马萨诸塞州总医院与哈佛医学院,波士顿,马萨诸塞州,美国);Department of Computer Science & Technology, University of Cambridge, Cambridge, UK(计算机科学与技术系,剑桥大学,剑桥,英国);Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA(癌症计划,哈佛与麻省理工联合学院,剑桥,马萨诸塞州,美国);Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA(数据科学计划,达纳-法伯癌症研究所,波士顿,马萨诸塞州,美国);Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, USA(哈佛-麻省理工健康科学与技术 division,麻省理工学院,剑桥,马萨诸塞州,美国);Télécom Paris, Institut Polytechnique de Paris, Paris, France(巴黎电信学院,巴黎理工学院,巴黎,法国);Harvard Data Science Initiative, Harvard University, Cambridge, MA, USA(哈佛大学数据科学倡议,哈佛大学,剑桥,马萨诸塞州,美国)
SPADE: Spatial Transcriptomics and Pathology Alignment Using a Mixture of Data Experts for an Expressive Latent Space
Biomedical AI Research Lab, University of California, Los Angeles(生物医学人工智能研究实验室,加州大学洛杉矶分校);Department of Pathology, University of California, Los Angeles(病理学系,加州大学洛杉矶分校);Department of Radiology, University of California, Los Angeles(放射学系,加州大学洛杉矶分校);Department of Bioengineering, University of California, Los Angeles(生物工程系,加州大学洛杉矶分校);UCLA Medical Informatics Home Area, University of California, Los Angeles(UCLA医学信息学家庭区域,加州大学洛杉矶分校);Department of Computational Medicine, University of California, Los Angeles(计算医学系,加州大学洛杉矶分校)
DUET: Dual-Paradigm Adaptive Expert Triage with Single-cell Inductive Prior for Spatial Transcriptomics Prediction
Vanderbilt University, Tennessee, USA(范德比尔特大学,田纳西州,美国);Weill Cornell Medicine, New York, USA(韦尔医学院,纽约,美国);Vanderbilt University Medical Center, Tennessee, USA(范德比尔特大学医学中心,田纳西州,美国)