Deep learning-based nuclei analysis in histopathology relies heavily on large-scale, expert-curated datasets that are costly and difficult to scale across organs. To address this, we propose a scalable framework leveraging cell-level spatial transcriptomics (ST) as an alternative supervision source for nuclei classification. Cell-level ST provides both gene expression profiles and nucleus masks, enabling automatic generation of image-label pairs without manual annotation. We convert gene expression into cell-type labels and introduce an image-oriented classification strategy to effectively transfer these identities to histopathology images. Evaluated on unseen tissues, our framework achieves comparable segmentation and classification performance compared with conventional supervised approaches, despite using fewer manually annotated datasets.
Segmentation-free integration of nuclei morphology and spatial transcriptomics for retinal images
Dept. of Information Technology(信息技术系);Dept. of Molecular, Cell and Developmental Biology(分子、细胞与发育生物学系);University of California, Los Angeles(加利福尼亚大学洛杉矶分校)
Tissue Aware Nuclei Detection and Classification Model for Histopathology Images
TIA Centre, Department of Computer Science, University of Warwick, UK(沃里克大学计算机科学系TIA中心,英国);GSK, Artificial Intelligence and Machine Learning, London, UK(葛兰素史克人工智能与机器学习,英国)
Fusing Pixels and Genes: Spatially-Aware Learning in Computational Pathology
College of Intelligent Robotics and Advanced Manufacturing, Fudan University(复旦大学智能机器人与先进制造学院);Fysics Intelligence Technologies Co., Ltd. (Fysics AI)(菲茨斯智能科技有限公司(菲茨斯AI));Department of Biomedical Informatics, Harvard Medical School(哈佛医学院生物医学信息学系);Tencent Youtu Lab(腾讯优图实验室);ByteDance(字节跳动)
HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysis
Mass General Brigham(麻省总医院布里格姆医疗系统);Harvard Medical School(哈佛医学院);ETH Zurich(苏黎世联邦理工学院);MIT(麻省理工学院);HST MIT(麻省理工学院卫生科学与技术部);TUM(慕尼黑工业大学);Helmholtz Munich(慕尼黑亥姆霍兹中心);Emory School of Medicine(埃默里医学院);Pusan National University(釜山国立大学)
SCR2-ST: Combine Single Cell with Spatial Transcriptomics for Efficient Active Sampling via Reinforcement Learning
Vanderbilt University(范德比大学);Weill Cornell Medicine(韦尔医学院);The College of William and Mary(威廉与玛丽学院);University of Liverpool(利物浦大学);Vanderbilt University Medical Center(范德比大学医学中心)
CellGenNet: A Knowledge-Distilled Framework for Robust Cell Segmentation in Cancer Tissues
a College of Computing, Georgia Institute of Technology, Atlanta, GA, USA b Department of Pediatrics, Emory University, Atlanta, GA, USA c Departments of Radiology \& Imaging Sciences, Emory University, Atlanta, GA, USA d Department of Biomedical Engineering, Emory University \& Georgia Institute of Technology, Atlanta, GA, USA e School of Electrical
TriDeNT: Triple Deep Network Training for Privileged Knowledge Distillation in Histopathology
School of Cancer Sciences, University of Glasgow(格拉斯哥大学癌症科学学院);Cancer Research UK Scotland Institute(英国癌症研究苏格兰研究所);School of Computing Science, University of Glasgow(格拉斯哥大学计算科学学院);School of Mathematics and Statistics, University of Glasgow(格拉斯哥大学数学与统计学院);Division of Biosciences, University College London(伦敦大学学院生物科学部)
Towards Spatial Transcriptomics-driven Pathology Foundation Models
Department of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA(病理学系,马萨诸塞州总医院与哈佛医学院,波士顿,马萨诸塞州,美国);Department of Computer Science & Technology, University of Cambridge, Cambridge, UK(计算机科学与技术系,剑桥大学,剑桥,英国);Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA(癌症计划,哈佛与麻省理工联合学院,剑桥,马萨诸塞州,美国);Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA(数据科学计划,达纳-法伯癌症研究所,波士顿,马萨诸塞州,美国);Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, USA(哈佛-麻省理工健康科学与技术 division,麻省理工学院,剑桥,马萨诸塞州,美国);Télécom Paris, Institut Polytechnique de Paris, Paris, France(巴黎电信学院,巴黎理工学院,巴黎,法国);Harvard Data Science Initiative, Harvard University, Cambridge, MA, USA(哈佛大学数据科学倡议,哈佛大学,剑桥,马萨诸塞州,美国)
VitaminP: cross-modal learning enables whole-cell segmentation from routine histology
Department of Translational Molecular Pathology, Division of Pathology and Laboratory Medicine, The University of Texas MD Anderson Cancer Center(转化分子病理学部门,病理与实验室医学分会,德克萨斯大学MD安德森癌症中心);Institute for Data Science in Oncology, The University of Texas MD Anderson Cancer Center(肿瘤数据科学研究所,德克萨斯大学MD安德森癌症中心);The University of Texas MD Anderson Cancer Center(德克萨斯大学MD安德森癌症中心)
CyclePose -- Leveraging Cycle-Consistency for Annotation-Free Nuclei Segmentation in Fluorescence Microscopy
Friedrich-Alexander-Universität (FAU)(弗里德里希-亚历山大-埃尔朗根-纽伦堡大学(FAU));Universität Würzburg(维尔茨堡大学);Center for AI and Data Science (CAIDAS)(人工智能与数据科学中心(CAIDAS))
Adapting SAM to Nuclei Instance Segmentation and Classification via Cooperative Fine-Grained Refinement
organization= College of Computer;Data Science , addressline= Fuzhou University , city= Fuzhou , country= China;organization= School of Mechanical Engineering;Automation , addressline= Fuzhou University , city= Fuzhou , country= China;organization= College of Physics;Information Engineering , addressline= Fuzhou University , city= Fuzhou , country= China
Segmentation-before-Staining Improves Structural Fidelity in Virtual IHC-to-Multiplex IF Translation
Interdisciplinary Program in Cancer Biology, Seoul National University College of Medicine(癌症生物学跨学科项目,首尔国立大学医学院);Interdisciplinary Program in Bioengineering, Seoul National University(生物工程跨学科项目,首尔国立大学);Department of Biomedical Sciences, Seoul National University(生物医学科学系,首尔国立大学);Department of Radiology, Seoul National University Hospital(放射科,首尔国立大学医院);Department of Radiology, Seoul National University College of Medicine(放射科,首尔国立大学医学院);Healthcare AI Research Institute, Seoul National University Hospital(医疗人工智能研究 institute,首尔国立大学医院)