Spatial Transcriptomics Analysis of Zero-shot Gene Expression Prediction
Biological Data Science Institute, The Australian National University(澳大利亚国立大学生物数据科学研究所);Optus Centre for AI, Curtin University(科廷大学Optus人工智能中心);Department of Electrical and Computer Engineering, North South University(南北大学电气与计算机工程系)
Yan Yang, Md Zakir Hossain, Xuesong Li, Shafin Rahman, Eric Stone
Spatial transcriptomics (ST) captures gene expression within distinct regions (i.e., windows) of a tissue slide. Traditional supervised learning frameworks applied to model ST are constrained to predicting expression from slide image windows for gene types seen during training, failing to generalize to unseen gene types. To overcome this limitation, we propose a semantic guided network (SGN), a pioneering zero-shot framework for predicting gene expression from slide image windows. Considering a gene type can be described by functionality and phenotype, we dynamically embed a gene type to a vector per its functionality and phenotype, and employ this vector to project slide image windows to gene expression in feature space, unleashing zero-shot expression prediction for unseen gene types. The gene type functionality and phenotype are queried with a carefully designed prompt from a pre-trained large language model (LLM). On standard benchmark datasets, we demonstrate competitive zero-shot performance compared to past state-of-the-art supervised learning approaches.
Sparser2Sparse: Single-shot Sparser-to-Sparse Learning for Spatial Transcriptomics Imputation with Natural Image Co-learning
Department of Radiology, Northwestern University, Chicago, IL, USA(放射科,西北大学,芝加哥,伊利诺伊州,美国);Department of Cell and Developmental Biology, Northwestern University, Chicago, IL, USA(细胞与发育生物学系,西北大学,芝加哥,伊利诺伊州,美国);Department of Pathology, Northwestern University, Chicago, IL, USA(病理学系,西北大学,芝加哥,伊利诺伊州,美国)
ST-Align: A Multimodal Foundation Model for Image-Gene Alignment in Spatial Transcriptomics
National Institute for Data Science in Health and Medicine, Xiamen University(厦门大学健康与医学数据科学国家研究院);School of Informatics, Xiamen University(厦门大学信息学院);Aginome Scientific(Aginome科技公司);School of Life Sciences, Xiamen University(厦门大学生命科学学院)
MagNet: Multi-Level Attention Graph Network for Predicting High-Resolution Spatial Transcriptomics
Vanderbilt University(范德堡大学);Weill Cornell Medicine(威尔康奈尔医学院);NVIDIA(英伟达公司);Vanderbilt University Medical Center(范德堡大学医学中心);UT MD Anderson Cancer Center(得克萨斯大学 MD 安德森癌症中心)
Integrating Pathology Foundation Models and Spatial Transcriptomics for Cellular Decomposition from Histology Images
School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA(电气与计算机工程学院,佐治亚理工学院);Department of Biomedical Engineering, Georgia Institute of Technology(生物医学工程系,佐治亚理工学院);Emory University, Atlanta, GA, USA(埃默里大学)
Learning Relative Gene Expression Trends from Pathology Images in Spatial Transcriptomics
Laboratory of Computational Life Science, National Cancer Center Japan(国立癌症中心日本计算生命科学实验室);Department of Advanced Information Technology, Kyushu University(九州大学先进信息技术系)
SPADE: Spatial Transcriptomics and Pathology Alignment Using a Mixture of Data Experts for an Expressive Latent Space
Biomedical AI Research Lab, University of California, Los Angeles(生物医学人工智能研究实验室,加州大学洛杉矶分校);Department of Pathology, University of California, Los Angeles(病理学系,加州大学洛杉矶分校);Department of Radiology, University of California, Los Angeles(放射学系,加州大学洛杉矶分校);Department of Bioengineering, University of California, Los Angeles(生物工程系,加州大学洛杉矶分校);UCLA Medical Informatics Home Area, University of California, Los Angeles(UCLA医学信息学家庭区域,加州大学洛杉矶分校);Department of Computational Medicine, University of California, Los Angeles(计算医学系,加州大学洛杉矶分校)
3D-Guided Scalable Flow Matching for Generating Volumetric Tissue Spatial Transcriptomics from Serial Histology
Cambridge Stem Cell Institute, University of Cambridge(剑桥干细胞研究所,剑桥大学);Cambridge Center for AI in Medicine, University of Cambridge(剑桥人工智能医学中心,剑桥大学);Department of Medicine, University of Cambridge(剑桥大学医学系);Computer Science Department, University of Oxford(牛津大学计算机科学系);Computer Science Department, University of Helsinki(赫尔辛基大学计算机科学系);Institute for Molecular Medicine Finland, University of Helsinki(芬兰分子医学研究所,赫尔辛基大学);Wellcome Sanger Institute(沃森桑格研究所)
Do Foundation Models See Biology? Evaluating Attention Coherence with Spatial Transcriptomics in Glioblastoma
Translational Medicine, School of Medicine, Queen’s University, Kingston, ON, Canada(转化医学、医学院、皇后大学、金斯顿,ON,加拿大);School of Computing, Queen’s University, Kingston, ON, Canada(计算学院、皇后大学、金斯顿,ON,加拿大);Department of Surgery, Queen’s University, Kingston, ON, Canada(外科部门、皇后大学、金斯顿,ON,加拿大)
Segmentation-free integration of nuclei morphology and spatial transcriptomics for retinal images
Dept. of Information Technology(信息技术系);Dept. of Molecular, Cell and Developmental Biology(分子、细胞与发育生物学系);University of California, Los Angeles(加利福尼亚大学洛杉矶分校)
Spatial Transcriptomics Expression Prediction from Histopathology Based on Cross-Modal Mask Reconstruction and Contrastive Learning
University of Regensburg(雷根斯堡大学);Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU)(埃尔朗根-纽伦堡弗里德里希-亚历山大大学);Beijing Friendship Hospital, Capital Medical University(首都医科大学附属北京友谊医院);Hanover Medical School(汉诺威医学院);University Clinic Freiburg(弗莱堡大学附属医院);Fraunhofer Institute for Digital Medicine MEVIS(弗劳恩霍夫数字医学研究所)
Spatial Transcriptomics as Images for Large-Scale Pretraining
Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);Hangzhou Institute for Advanced Study, University of the Chinese Academy of Sciences(中国科学院大学杭州高等研究院)
Contrastive and Adaptive Multi-modal Masked Autoencoder for Spatial Transcriptomics
Department of Artificial Intelligence, Yonsei University(延世大学人工智能系);Department of Computer Science, Yonsei University(延世大学计算机科学系);Yonsei University College of Medicine(延世大学医学院)
Mass General Brigham(麻省总医院布里格姆医疗系统);Harvard Medical School(哈佛医学院);Broad Institute of Harvard and MIT(哈佛与麻省理工学院布罗德研究所);Dana-Farber Cancer Institute(丹娜法伯癌症研究院);Harvard-MIT Division of Health Sciences and Technology(哈佛-麻省理工卫生科学与技术部);Massachusetts Institute of Technology(麻省理工学院);Pusan National University(釜山国立大学);Emory University School of Medicine(埃默里大学医学院);University of Cambridge(剑桥大学);Rutgers Robert Wood Johnson Medical School(罗格斯大学罗伯特伍德约翰逊医学院);Johns Hopkins Hospital(约翰霍普金斯医院);Beth Israel Deaconess Medical Center(贝斯以色列女执事医疗中心)
Towards Unified Molecule-Enhanced Pathology Image Representation Learning via Integrating Spatial Transcriptomics
Academy for Engineering and Technology, Fudan University(复旦大学工程技术研究院);Cognition and Intelligent Technology Laboratory, Fudan University(复旦大学认知与智能技术实验室);Shanghai Jiaotong University(上海交通大学);Fudan University(复旦大学)
Global Context-aware Representation Learning for Spatially Resolved Transcriptomics
Graduate School of Data Science, KAIST, Daejeon, Republic of Korea;Department of Industrial \& Systems Engineering, KAIST, Daejeon, Republic of Korea;Department of Mathematical Sciences, KAIST, Daejeon, Republic of Korea
High-Resolution Spatial Transcriptomics from Histology Images using HisToSGE
School of Information Science and Engineering, Yunnan University(云南大学信息科学与工程学院);College of Nursing Health Sciences, Yunnan Open University(云南开放大学护理与健康科学学院)
GC-MoE: Genomics-Guided Cell-Type-Specific Mixture of Experts for Histology-Based Single-Cell Spatial Transcriptomics
Kyushu University(九州大学);German Research Center for Artificial Intelligence (DFKI GmbH)(德国人工智能研究中心);RPTU University Kaiserslautern-Landau(科布伦茨-劳恩堡大学);The University of Osaka(大阪大学);IntelligentX GmbH;Osaka Metropolitan University(大阪 Metropolitan 大学)
Multi-Slice Spatial Transcriptomics Data Integration Analysis with STG3Net
School of Information Science and Engineering, Yunnan University(云南大学信息科学与工程学院);College of Nursing Health Sciences, Yunnan Open University(云南开放大学护理健康学院)
Cross-modal Diffusion Modelling for Super-resolved Spatial Transcriptomics
Department of Clinical Neurosciences, University of Cambridge, UK(剑桥大学临床神经科学系);Department of Applied Mathematics and Theoretical Physics, University of Cambridge, UK(剑桥大学应用数学与理论物理系);School of Science and Engineering, University of Dundee, UK(邓迪大学科学与工程学院);School of Medicine, University of Dundee, UK(邓迪大学医学院);Zhejiang Lab, China(浙江实验室)
PAST: A multimodal single-cell foundation model for histopathology and spatial transcriptomics in cancer
King Abdullah University of Science and Technology (KAUST)(阿卜杜拉国王科技大学);Shanghai Academy of Artificial Intelligence for Science(上海科学智能研究院);Fudan University(复旦大学);Zhongshan Hospital, Fudan University(复旦大学附属中山医院)