Histopathology image synthesis plays an important role in tissue restoration, data augmentation, and modeling of tumor microenvironments. However, existing generative methods typically address restoration and generation as separate tasks, although both share the same objective of structure-consistent tissue synthesis under varying degrees of missingness, and often rely on weak or inconsistent structural priors that limit realistic cellular organization.
We propose Dual-LoRA Controllable Diffusion, a unified centroid-guided diffusion framework that jointly supports Local Structure Completion and Global Structure Synthesis within a single model. Multi-class nuclei centroids serve as lightweight and annotation-efficient spatial priors, providing biologically meaningful guidance under both partial and complete image absence. Two task-specific LoRA adapters specialize the shared backbone for local and global objectives without retraining separate diffusion models. Extensive experiments demonstrate consistent improvements over state-of-the-art GAN and diffusion baselines across restoration and synthesis tasks.
For local completion, LPIPS computed within the masked region improves from 0.1797 (HARP) to 0.1524, and for global synthesis, FID improves from 225.15 (CoSys) to 76.04, indicating improved structural fidelity and realism. Our approach achieves more faithful structural recovery in masked regions and substantially improved realism and morphology consistency in full synthesis, supporting scalable pan-cancer histopathology modeling.
Existing deep neural networks for histopathology image synthesis cannot generate image styles that align with different organs, and cannot produce accurate boundaries of clustered nuclei. To address these issues, we propose a style-guided instance-adaptive normalization (SIAN) approach to synthesize realistic color distributions and textures for histopathology images from different organs. SIAN contains four phases, semantization, stylization, instantiation, and modulation. The first two phases synthesize image semantics and styles by using semantic maps and learned image style vectors. The in…
Grading of cancer is important to know the extent of its spread. Prior to grading, segmentation of glandular structures is important. Manual segmentation is a time consuming process and is subject to observer bias. Hence, an automated process is required to segment the gland structures. These glands show a large variation in shape size and texture. This makes the task challenging as the glands cannot be segmented using mere morphological operations and conventional segmentation mechanisms. In this project we propose a method which detects the boundary epithelial cells of glands and then a nove…
University of Notre Dame(圣母大学);Allen Institute for Cell Science(艾伦细胞科学研究所)
Automatic histopathology image segmentation is crucial to disease analysis. Limited available labeled data hinders the generalizability of trained models under the fully supervised setting. Semi-supervised learning (SSL) based on generative methods has been proven to be effective in utilizing diverse image characteristics. However, it has not been well explored what kinds of generated images would be more useful for model training and how to use such images. In this paper, we propose a new data guided generative method for histopathology image segmentation by leveraging the unlabeled data dist…
CoDiR: Confidence-Guided Diffusion Refinement for Semi-Supervised Histopathology Segmentation
AI VIETNAM Lab(AI VIETNAM实验室);Portland Community College(波特兰社区学院);University of Science, VNU-HCM(胡志明市国家大学科学大学);Hanoi University of Science and Technology(河内科技大学);Jeonbuk National University(全北国立大学);Washington University School of Medicine(华盛顿大学医学院);Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院)
EEG-Driven Image Reconstruction with Saliency-Guided Diffusion Models
Ivannikov Institute for System Programming of the Russian Academy of Sciences(俄罗斯科学院伊万诺夫系统编程研究所);Research Center for Trusted Artificial Intelligence(可信人工智能研究中心);AI Talent Hub, ITMO University(ITMO大学人工智能人才中心);Moscow, Russia(俄罗斯莫斯科)
University of Tübingen(蒂宾根大学);Helmholtz Munich(亥姆霍兹慕尼黑中心);TUM(慕尼黑工业大学);Inria(法国国家信息与自动化研究所);Ecole normale supérieure(巴黎高等师范学院);CNRS(法国国家科学研究中心);PSL Research University(巴黎文理研究大学)
ProBAG: Prototype-Guided Boundary-Aware Graph Diffusion for Weakly Supervised Histopathology Segmentation
AI VIETNAM Lab(AI越南实验室);Washington University School of Medicine(华盛顿大学医学院);Jeonbuk National University(全北国立大学);Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院)
DualProtoSeg: Simple and Efficient Design with Text- and Image-Guided Prototype Learning for Weakly Supervised Histopathology Image Segmentation
University of Houston(德克萨斯大学休斯顿分校);Ho Chi Minh City University of Technology(胡志明市技术大学);University of Information Technology(信息技术大学);University of Technology Sydney(悉尼技术大学);Vin University(文大学);Department of Computer Science, Emory University(埃默里大学计算机科学系);College of Medical Science and Technology, Taipei Medical University(台北医学院医学科学与技术学院);Montefiore Medical Center, Albert Einstein College of Medicine(蒙特福医院,阿尔伯特·爱因斯坦医学院);School of Computer Science, Carnegie Mellon University(卡内基梅隆大学计算机科学学院)
Faculty of Informatics and Data Science, University of Regensburg, Germany(信息学与数据科学学院,雷根萨大学);Indian Institute of Information Technology Bhopal, India(比哈尔信息学院)
AWGUNET: Attention-Aided Wavelet Guided U-Net for Nuclei Segmentation in Histopathology Images
Jadavpur University(jadavpur大学);Artificial Intelligence Research Institute, China University of Mining and Technology(中国矿业大学人工智能研究院);Saint Petersburg Electrotechnical University "LETI"(圣彼得堡国立电工技术大学"LETI")
Semi-supervised learning (semi-SL) is a promising alternative to supervised learning for medical image analysis when obtaining good quality supervision for medical imaging is difficult. However, semi-SL assumes that the underlying distribution of unaudited data matches that of the few labeled samples, which is often violated in practical settings, particularly in medical images. The presence of out-of-distribution (OOD) samples in the unlabeled training pool of semi-SL is inevitable and can reduce the efficiency of the algorithm. Common preprocessing methods to filter out outlier samples may n…
MeDi: Metadata-Guided Diffusion Models for Mitigating Biases in Tumor Classification
Machine Learning Group, Technische Universität Berlin, Germany The Konrad Zuse School of Excellence in Learning;Intelligent Systems (ELIZA), Germany BIFOLD – Berlin Institute for the Foundations of Learning
MGCT: Mutual-Guided Cross-Modality Transformer for Survival Outcome Prediction using Integrative Histopathology-Genomic Features
Heilongjiang University(黑龙江大学);La Trobe University(拉筹伯大学);University of South China(南华大学);The First Affiliated Hospital(第一附属医院);Hengyang Medical School(衡阳医学院);School of Basic Medical Sciences(基础医学院)
Retrieval-Guided Generation for Safer Histopathology Image Captioning
Kimia Lab, Department of Artificial Intelligence \& Informatics, Mayo Clinic, Rochester, MN, USA;Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, USA;Lane Department of Computer Science;Electrical Engineering, West Virginia University, Morgantown, WV, USA;Department of Computer Science;Engineering, Princeton University, Princeton, NJ, USA;Department of Computer Sciences, University of Wisconsin--Madison, Madison, WI, USA
Beyond Low-Rank Tuning: Model Prior-Guided Rank Allocation for Effective Transfer in Low-Data and Large-Gap Regimes
School of Automation and Intelligent Sensing, Institute of Medical Robotics, Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University(自动化与智能感知学院、医疗机器人研究院、图像处理与模式识别研究院、上海交通大学)
PILoRA: Prototype Guided Incremental LoRA for Federated Class-Incremental Learning
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Centre for Artificial Intelligence and Robotics, Hong Kong Institute of Science and Innovation, Chinese Academy of Sciences(中国科学院香港创新研究院人工智能与机器人中心)
Adaptive Multi-Scale Integration Unlocks Robust Cell Annotation in Histopathology Images
Department of Computer and Information Science, University of Pennsylvania(计算机与信息科学系,宾夕法尼亚大学);Department of Bioengineering, University of Pennsylvania(生物工程系,宾夕法尼亚大学);Department of Pathology and Laboratory Medicine, University of Pennsylvania(病理学与实验室医学系,宾夕法尼亚大学);Department of Biostatistics, Epidemiology and Informatics, University of Pennsylvania(生物统计学、流行病学与信息学系,宾夕法尼亚大学)
ConStruct: Structural Distillation of Foundation Models for Prototype-Based Weakly Supervised Histopathology Segmentation
Ho Chi Minh City University of Technology(胡志明市技术大学);University of Technology Sydney(悉尼技术大学);University of Houston(休斯顿大学);University of Information Technology(信息科技大学);College of Medical Science and Technology, Taipei Medical University(台北医学院医学科技学院);Department of Computer Science, Emory University(埃默里大学计算机科学系);Montefiore Medical Center, Albert Einstein College of Medicine(蒙特福伊医疗中心,阿尔伯特·爱因斯坦医学院);School of Computer Science, Carnegie Mellon University(卡内基梅隆大学计算机科学学院)
LoRA-IR: Taming Low-Rank Experts for Efficient All-in-One Image Restoration
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
RankByGene: Gene-Guided Histopathology Representation Learning Through Cross-Modal Ranking Consistency
Stony Brook University(石英溪大学);Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School(阿提诺拉A.马丁努斯生物医学影像中心,麻省总医院和哈佛医学院);Department of Biomedical Data Science, Stanford University(生物医学数据科学系,斯坦福大学);Department of Pathology and Cell Biology, Columbia University(病理学与细胞生物学系,哥伦比亚大学)
Interpretable Few-Shot Image Classification via Prototypical Concept-Guided Mixture of LoRA Experts
School of Electrical and Information Engineering, Tianjin Key Laboratory of Brain-Inspired Intelligence Technology, Tianjin University(电子工程学院,天津脑启发智能技术重点实验室,天津大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Department of Automation, Tsinghua University(自动化系,清华大学)