arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.09121cs.CVcs.AI
收藏

MSDM:利用多模态条件扩散模型生成任务特异性病理图像,用于细胞和细胞核分割

MSDM: Generating Task-Specific Pathology Images with a Multimodal Conditioned Diffusion Model for Cell and Nuclei Segmentation

AstraZeneca Computational Pathology GmbH(阿斯利康计算病理学 GmbH)

Dominik Winter, Mai Bui, Monica Azqueta Gavaldon, Nicolas Triltsch, Marco Rosati, Nicolas Brieu

AI总结:

本文提出多模态语义扩散模型MSDM,通过形态、颜色和元数据条件生成像素精确的病理图像-掩膜对,以增强数据并提升细胞与细胞核分割性能。

摘要:

标注数据的稀缺,尤其是罕见或非典型形态相关数据的稀缺,给计算病理学中的细胞和细胞核分割带来了重大挑战。人工标注既费力又昂贵,而合成数据提供了一种具有成本效益的替代方案。我们提出了多模态语义扩散模型(Multimodal Semantic Diffusion Model,MSDM),用于生成逼真且像素精确的图像-掩膜对,以服务于细胞和细胞核分割。通过利用细胞/细胞核形态(使用水平和垂直映射)、RGB颜色特征以及经BERT编码的检测/适应症元数据来条件化生成过程,MSDM可生成具有所需形态属性的数据集。这些异质模态通过多头交叉注意力进行整合,从而实现对生成图像的细粒度控制。定量分析表明,合成图像与真实数据高度匹配:在匹配的生物学条件下,生成图像与真实图像的嵌入之间具有较低的Wasserstein距离。将这些合成样本纳入训练(以柱状细胞为例)显著提升了分割模型在柱状细胞上的准确率。该策略系统性地丰富了数据集,直接针对模型的不足之处。我们强调了基于多模态扩散的数据增强在提升细胞和细胞核分割模型鲁棒性与泛化能力方面的有效性,从而为生成模型在计算病理学中更广泛的应用铺平道路。

英文摘要:

Scarcity of annotated data, particularly for rare or atypical morphologies, present significant challenges for cell and nuclei segmentation in computational pathology. While manual annotation is labor-intensive and costly, synthetic data offers a cost-effective alternative. We introduce a Multimodal Semantic Diffusion Model (MSDM) for generating realistic pixel-precise image-mask pairs for cell and nuclei segmentation. By conditioning the generative process with cellular/nuclear morphologies (using horizontal and vertical maps), RGB color characteristics, and BERT-encoded assay/indication metadata, MSDM generates datasests with desired morphological properties. These heterogeneous modalities are integrated via multi-head cross-attention, enabling fine-grained control over the generated images. Quantitative analysis demonstrates that synthetic images closely match real data, with low Wasserstein distances between embeddings of generated and real images under matching biological conditions. The incorporation of these synthetic samples, exemplified by columnar cells, significantly improves segmentation model accuracy on columnar cells. This strategy systematically enriches data sets, directly targeting model deficiencies. We highlight the effectiveness of multimodal diffusion-based augmentation for advancing the robustness and generalizability of cell and nuclei segmentation models. Thereby, we pave the way for broader application of generative models in computational pathology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑