Spatial transcriptomics (ST) has emerged as an advanced technology that provides spatial context to gene expression. Recently, deep learning-based methods have shown the capability to predict gene expression from WSI data using ST data. Existing approaches typically extract features from images and the neighboring regions using pretrained models, and then develop methods to fuse this information to generate the final output. However, these methods often fail to account for the cellular structure similarity, cellular density and the interactions within the microenvironment. In this paper, we propose a framework named BG-TRIPLEX, which leverages boundary information extracted from pathological images as guiding features to enhance gene expression prediction from WSIs. Specifically, our model consists of three branches: the spot, in-context and global branches. In the spot and in-context branches, boundary information, including edge and nuclei characteristics, is extracted using pretrained models. These boundary features guide the learning of cellular morphology and the characteristics of microenvironment through Multi-Head Cross-Attention. Finally, these features are integrated with global features to predict the final output. Extensive experiments were conducted on three public ST datasets. The results demonstrate that our BG-TRIPLEX consistently outperforms existing methods in terms of Pearson Correlation Coefficient (PCC). This method highlights the crucial role of boundary features in understanding the complex interactions between WSI and gene expression, offering a promising direction for future research.
Spatial Transcriptomics-Guided Alignment Enhances Molecular Profiling in Pathology Foundation Model
Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong SAR, China(计算机科学与工程系,香港科学与技术大学,香港特别行政区,中国);Department of Pathology, Nanfang Hospital, Southern Medical University, Guangzhou, China(pathology department, 南方医科大学南芳医院,广州,中国);Department of Pathology, School of Basic Medical Sciences, Southern Medical University, Guangzhou, China(pathology department, 南方医科大学基础医学学院,广州,中国);Guangdong Province Key Laboratory of Molecular Tumor Pathology, Guangzhou, China(广东省分子肿瘤病理学重点实验室,广州,中国);Jinfeng Laboratory, Chongqing, China(金风实验室,重庆,中国)
GC-MoE: Genomics-Guided Cell-Type-Specific Mixture of Experts for Histology-Based Single-Cell Spatial Transcriptomics
Kyushu University(九州大学);German Research Center for Artificial Intelligence (DFKI GmbH)(德国人工智能研究中心);RPTU University Kaiserslautern-Landau(科布伦茨-劳恩堡大学);The University of Osaka(大阪大学);IntelligentX GmbH;Osaka Metropolitan University(大阪 Metropolitan 大学)
GeneICL: A Tabular Foundation Model for Bulk Transcriptomics
ETH Zurich(苏黎世联邦理工学院);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Swiss Institute of Bioinformatics(瑞士生物信息学研究所);Université Paris Cité(巴黎西岱大学)
Benchmarking Dimensionality Reduction Techniques for Spatial Transcriptomics
Institute for Clarity in Documentation(清晰文档研究所);Inria Paris-Rocquencourt(巴黎-罗克奎恩特研究所);Rajiv Gandhi University(拉贾夫·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒尔研究实验室)
stMCDI: Masked Conditional Diffusion Model with Graph Neural Network for Spatial Transcriptomics Data Imputation
School of Information Science and Engineering, Yunnan University(云南大学信息科学与工程学院);Shenzhen Research Institute of Big Data(深圳大数据研究院);Hefei Institutes of Physical Science, Chinese Academy of Science(中国科学院合肥物质科学研究院)
SToFM: a Multi-scale Foundation Model for Spatial Transcriptomics
Department of Computer Science and Tecnology, Tsinghua University(清华大学计算机科学与技术系);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院);School of Mathematical Sciences, Peking University(北京大学数学科学学院);PharMolix Inc.(PharMolix公司)
Transcriptomic Models for Immunotherapy Response Prediction Show Limited Cross-cohort Generalisability
UNSW BioMedical Machine Learning Lab (BML), School of Biomedical Engineering, UNSW Sydney(UNSW生物医学机器学习实验室(BML),生物医学工程学院,UNSW悉尼);School of Biomedical Engineering, UNSW(生物医学工程学院,UNSW);Department of Computer Science, Zhejiang University(浙江大学计算机科学系);Institute for Intelligent Systems Research and Innovation, Deakin University(智能系统研究与创新研究所,德金大学);School of Engineering & Technology, Duy Tan University(工程与技术学院,杜益大学);School of Computing, Macquarie University(计算学院,麦觉大学);Center of Excellence in Precision Medicine and Digital Health, Faculty of Dentistry, Chulalongkorn University(精准医学与数字健康中心,牙科学院,朱拉隆功大学)
hSNMF: Hybrid Spatially Regularized NMF for Image-Derived Spatial Transcriptomics
Department of Electrical and Computer Engineering, University of Houston(电气与计算机工程系,休斯顿大学);Department of Genomic Medicine and MDACC Epigenomics Therapy Initiative (METI)(基因医学系和MDACC表观遗传学治疗计划(METI));MD Anderson Cancer Center, Houston TX, USA(MD安德森癌症中心,休斯顿德克萨斯州,美国);Department of Information Science Technology, University of Houston(信息科学与技术系,休斯顿大学)
Modeling Microenvironment Trajectories on Spatial Transcriptomics with NicheFlow
School of Computation, Information and Technology, Technical University of Munich(慕尼黑技术大学计算、信息与技术学院);Munich Centre for Machine Learning (MCML)(慕尼黑机器学习中心);Institute of Computational Biology, Helmholtz Munich(海德堡医学院计算生物学研究所);Munich Data Science Institute (MDSI), Technical University of Munich(慕尼黑数据科学研究所);TUM School of Life Sciences Weihenstephan, Technical University of Munich(慕尼黑技术大学生命科学学院)
CASPER: Cross-modal Alignment of Spatial and single-cell Profiles for Expression Recovery
Department of Computer Science \& Engineering, Indian Institute of Technology Ropar, India Qatar Computing Research Institute, Hamad Bin Khalifa University, Doha, Qatar. Department of Biomedical Engineering, Indian Institute of Technology Ropar, India
SpaFactor: Lightweight Spatial Context-Aware Gene Program Modeling for Histology-to-Transcriptomics Inference
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Fuzhou University(福州大学);Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University(清华大学附属北京清华长庚医院,清华大学临床医学院);Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院 北京协和医学院)
Masked Graph Autoencoders with Contrastive Augmentation for Spatially Resolved Transcriptomics Data
School of Information Science and Engineering, Yunnan University(云南大学信息科学与工程学院);College of Nursing Health Sciences, Yunnan Open University(云南开放大学护理与健康科学学院)
Global Context-aware Representation Learning for Spatially Resolved Transcriptomics
Graduate School of Data Science, KAIST, Daejeon, Republic of Korea;Department of Industrial \& Systems Engineering, KAIST, Daejeon, Republic of Korea;Department of Mathematical Sciences, KAIST, Daejeon, Republic of Korea
A Unified Geometric Framework for Developmental Analysis of Spatial Transcriptomic Data
University of Cambridge(剑桥大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Loyola University Chicago(芝加哥洛约拉大学);Pomona College(波莫纳学院);University of Nebraska-Lincoln(内布拉斯加大学林肯分校)
scBIT: Integrating Single-cell Transcriptomic Data into fMRI-based Prediction for Alzheimer's Disease Diagnosis
School of Computer Science, Northwestern Polytechnical University(西北工业大学计算机学院);Research & Development Institute of Northwestern Polytechnical University in Shenzhen(西北工业大学深圳研究院);The Hong Kong Polytechnic University(香港理工大学);City University of Hong Kong (Dongguan)(香港城市大学(东莞))
Multi-Slice Spatial Transcriptomics Data Integration Analysis with STG3Net
School of Information Science and Engineering, Yunnan University(云南大学信息科学与工程学院);College of Nursing Health Sciences, Yunnan Open University(云南开放大学护理健康学院)
Cross-modal Diffusion Modelling for Super-resolved Spatial Transcriptomics
Department of Clinical Neurosciences, University of Cambridge, UK(剑桥大学临床神经科学系);Department of Applied Mathematics and Theoretical Physics, University of Cambridge, UK(剑桥大学应用数学与理论物理系);School of Science and Engineering, University of Dundee, UK(邓迪大学科学与工程学院);School of Medicine, University of Dundee, UK(邓迪大学医学院);Zhejiang Lab, China(浙江实验室)
STARK denoises spatial transcriptomics images via adaptive regularization
Department of Mathematics, University of British Columbia(数学系,不列颠哥伦比亚大学);Department of Computer Science, University of British Columbia(计算机科学系,不列颠哥伦比亚大学);Department of Mathematics and Mathematical Statistics, Umeå University(数学与统计学系,乌梅大学);Premium Research Institute for Human Metaverse Medicine (WPI-PRIMe), The University of Osaka(人类元宇宙医学研究学院(WPI-PRIMe),大阪大学)