arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.12716cs.CVcs.LGeess.IV

UNIStainNet:基于基础模型的虚拟染色:H&E到IHC

UNIStainNet: Foundation-Model-Guided Virtual Staining of H&E to IHC

University of Texas at Arlington(德克萨斯理工大学);St. Jude Children’s Research Hospital(圣 Jude 儿童研究医院)

Jillur Rahman Saurav, Thuong Le Hoai Pham, Pritam Mukherjee, Paul Yi, Brent A. Orr, Jacob M. Luber

AI总结:

UNIStainNet通过结合基础模型生成的密集空间标记,提升H&E到IHC的虚拟染色效果,实现多标记同时处理,并在MIST和BCI数据集上取得最佳分布度指标。

摘要:

虚拟免疫组化(IHC)染色可以从血清素和伊红(H&E)图像加速诊断,通过直接从常规切片提供初步分子信息,减少组织有限时重复切片的需要。现有方法通过对比目标、原型匹配或领域对齐提升现实感,但生成器本身未直接接受病理基础模型的指导。我们提出了UNIStainNet,一种基于冻结病理基础模型(UNI)的SPADE-UNet,提供组织层面的语义指导进行染色转换。一种误对齐感知的损失套件保持染色量化准确性,而学习的染色嵌入使单个模型能够同时服务于多种IHC标记。在MIST上,UNIStainNet在所有四个染色(HER2、Ki67、ER、PR)上实现了最先进的分布度指标,而先前方法通常训练单独的每种染色模型。在BCI上,它也实现了最佳分布度指标。一种组织类型分层的失败分析揭示,剩余误差是系统性的,集中在非肿瘤组织。代码可在https://github.com/facevoid/UNIStainNet上获得。

英文摘要:

Virtual immunohistochemistry (IHC) staining from hematoxylin and eosin (H&E) images can accelerate diagnostics by providing preliminary molecular insight directly from routine sections, reducing the need for repeat sectioning when tissue is limited. Existing methods improve realism through contrastive objectives, prototype matching, or domain alignment, yet the generator itself receives no direct guidance from pathology foundation models. We present UNIStainNet, a SPADE-UNet conditioned on dense spatial tokens from a frozen pathology foundation model (UNI), providing tissue-level semantic guidance for stain translation. A misalignment-aware loss suite preserves stain quantification accuracy, and learned stain embeddings enable a single model to serve multiple IHC markers simultaneously. On MIST, UNIStainNet achieves state-of-the-art distributional metrics on all four stains (HER2, Ki67, ER, PR) from a single unified model, where prior methods typically train separate per-stain models. On BCI, it also achieves the best distributional metrics. A tissue-type stratified failure analysis reveals that remaining errors are systematic, concentrating in non-tumor tissue. Code is available at https://github.com/facevoid/UNIStainNet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑