ST2HE: A Cross-Platform Framework for Virtual Histology and Annotation of High-Resolution Spatial Transcriptomics Data
University of Pittsburgh(匹兹堡大学);UPMC Hillman Cancer Center(UPMC希尔曼癌症中心);University of Pittsburgh School of Medicine(匹兹堡大学医学院);University of Pittsburgh Medical Center Hillman Cancer Center(UPMC医疗中心希尔曼癌症中心);Pittsburgh Liver Research Center, University of Pittsburgh Medical Center and University of Pittsburgh School of Medicine(匹兹堡肝脏研究中心,UPMC医疗中心和匹兹堡大学医学院)
High-resolution spatial transcriptomics (HR-ST) technologies offer unprecedented insights into tissue architecture but lack standardized frameworks for histological annotation. We present ST2HE, a cross-platform generative framework that synthesizes virtual hematoxylin and eosin (H&E) images directly from HR-ST data. ST2HE integrates nuclei morphology and spatial transcript coordinates using a one-step diffusion model, enabling histologically faithful image generation across diverse tissue types and HR-ST platforms. Conditional and tissue-independent variants support both known and novel tissue contexts. Evaluations on breast cancer, non-small cell lung cancer, and Kaposi's sarcoma demonstrate ST2HE's ability to preserve morphological features and support downstream annotations of tissue histology and phenotype classification. Ablation studies reveal that larger context windows, balanced loss functions, and multi-colored transcript visualization enhance image fidelity. ST2HE bridges molecular and histological domains, enabling interpretable, scalable annotation of HR-ST data and advancing computational pathology.
A Multimodal Foundation Model of Spatial Transcriptomics and Histology for Biological Discovery and Clinical Prediction
Department of Radiation Oncology, Stanford University School of Medicine(斯坦福大学医学院放射肿瘤学系);Department of Statistics and Data Science, Yale University(耶鲁大学统计与数据科学系);Department of Medicine (Oncology), Stanford University School of Medicine(斯坦福大学医学院医学系(肿瘤学));Department of Pathology, Stanford University School of Medicine(斯坦福大学医学院病理学系);Department of Neurosurgery, Stanford University School of Medicine(斯坦福大学医学院神经外科学系);Stanford Institute for Human-Centered Artificial Intelligence(斯坦福大学以人为本人工智能研究所);Perelman School of Medicine at the University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院)
SpaFactor: Lightweight Spatial Context-Aware Gene Program Modeling for Histology-to-Transcriptomics Inference
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Fuzhou University(福州大学);Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University(清华大学附属北京清华长庚医院,清华大学临床医学院);Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院 北京协和医学院)
Cross-modal Diffusion Modelling for Super-resolved Spatial Transcriptomics
Department of Clinical Neurosciences, University of Cambridge, UK(剑桥大学临床神经科学系);Department of Applied Mathematics and Theoretical Physics, University of Cambridge, UK(剑桥大学应用数学与理论物理系);School of Science and Engineering, University of Dundee, UK(邓迪大学科学与工程学院);School of Medicine, University of Dundee, UK(邓迪大学医学院);Zhejiang Lab, China(浙江实验室)
Virtual staining for 3D X-ray histology of bone implants
Institute of Materials Physics(材料物理研究所);Helmholtz-Zentrum Hereon(海德堡研究中心);Institute of Metallic Biomaterials(金属生物材料研究所);Bruker Daltonics SPR(布鲁克尔达特利克斯SPR);Data-Driven Analysis and Design of Materials(数据驱动的材料分析与设计);University of Rostock(罗斯托克大学)
CHRep: Cross-modal Histology Representation and Post-hoc Calibration for Spatial Gene Expression Prediction
Beijing University of Posts and Telecommunications(北京邮电大学);Beijing Key Laboratory of Network System and Network Culture(北京网络系统与网络文化重点实验室);Peking University Third Hospital(北京大学第三医院)
Label- and slide-free tissue histology using 3D epi-mode quantitative phase imaging and virtual H&E staining
University of California, Davis(加利福尼亚大学戴维斯分校);Georgia Institute of Technology(佐治亚理工学院);Emory University(埃默里大学);Emory University School of Medicine(埃默里大学医学院);UC Davis Health(加州大学戴维斯分校医疗系统)
PAST: A multimodal single-cell foundation model for histopathology and spatial transcriptomics in cancer
King Abdullah University of Science and Technology (KAUST)(阿卜杜拉国王科技大学);Shanghai Academy of Artificial Intelligence for Science(上海科学智能研究院);Fudan University(复旦大学);Zhongshan Hospital, Fudan University(复旦大学附属中山医院)
Photon Absorption Remote Sensing Virtual Histopathology: A Preliminary Exploration of Diagnostic Equivalence to Gold-Standard H&E Staining in Skin Cancer Excisional Biopsies
University of Waterloo(滑铁卢大学);University of Calgary(卡尔加里大学);University of Toronto(多伦多大学);Indiana University School of Medicine(印第安纳大学医学院);SkinMD LLC(SkinMD有限责任公司);University of Alberta(阿尔伯塔大学);illumiSonics Inc(illumiSonics公司)
RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency
Stony Brook University(石英溪大学);Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School(阿提诺拉A.马丁努斯生物医学影像中心,麻省总医院和哈佛医学院);Department of Biomedical Data Science, Stanford University(生物医学数据科学系,斯坦福大学);Department of Pathology and Cell Biology, Columbia University(病理学与细胞生物学系,哥伦比亚大学)
Pathology-genomic fusion via biologically informed cross-modality graph learning for survival analysis
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Beijing Tiantan Hospital, Capital Medical University(首都医科大学附属北京天坛医院);First Affiliated Hospital of Zhengzhou University(郑州大学第一附属医院)
Empowering Chemical Structures with Biological Insights for Scalable Phenotypic Virtual Screening
State Key Laboratory of Chemo and Biosensing, College of Computer Science and Electronic Engineering(化学与生物传感国家重点实验室,计算机科学与电子工程学院;教育部长江超级计算与人工智能融合计算重点实验室);The Ministry of Education Key Laboratory of Fusion Computing of Supercomputing and Artificial Intelligence(湖南大学);Hunan University(人工智能与计算机科学学院);School of Artificial Intelligence and Computer Science(江南大学);Jiangnan University(计算机科学系);Department of Computer Science(筑波大学);University of Tsukuba(中医学学院);School of Chinese Medicine(香港 Baptist 大学);Hong Kong Baptist University(信息学院,国家健康与医学数据科学研究院);School of Informatics, National Institute for Data Science in Health and Medicine