arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2510.07129cs.CVcs.AI
收藏

图条件扩散用于可控的组织病理学图像生成

Graph Conditioned Diffusion for Controllable Histopathology Image Generation

Department of Computing, Imperial College London, UK(帝国理工学院计算系);Weill Cornell Medicine, NY, USA(韦尔·科恩医学中心);Cornell Tech, NY, USA(康奈尔科技);Centre for Inflammatory Disease, Imperial College London, London, UK(帝国理工学院炎症疾病研究中心)

Sarah Cechnicka, Matthew Baugh, Weitong Zhang, Mischa Dombrowski, Zhe Li, Johannes C. Paetzold, Candice Roufosse, Bernhard Kainz

AI总结:

针对医学图像生成中缺乏语义控制的问题,提出基于图物体级表示的图条件扩散模型,通过Transformer和文本条件机制实现细粒度生成,并在组织病理学分割任务中验证其数据可替代真实标注数据。

摘要:

扩散概率模型(DPMs)的最新进展在高品质图像合成领域树立了新的标准。然而,受控生成仍然具有挑战性,尤其是在医学影像等敏感领域。医学图像具有固有的结构,如一致的空间排列、形状或纹理,这些对于诊断都至关重要。然而,现有的DPMs在缺乏语义结构和强先验的噪声潜在空间中操作,使得难以确保对生成内容进行有意义的控制。为了解决这一问题,我们提出了基于图的物体级表示用于图条件扩散(Graph-Conditioned-Diffusion)。我们的方法生成与图像中每个主要结构相对应的图节点,封装它们的个体特征和关系。这些图表示由Transformer模块处理,并通过文本条件机制集成到扩散模型中,从而实现对生成的细粒度控制。我们使用真实世界的组织病理学用例评估了该方法,证明我们生成的数据在下游分割任务中可以可靠地替代带注释的患者数据。代码可在此处获取。

英文摘要:

Recent advances in Diffusion Probabilistic Models (DPMs) have set new standards in high-quality image synthesis. Yet, controlled generation remains challenging, particularly in sensitive areas such as medical imaging. Medical images feature inherent structure such as consistent spatial arrangement, shape or texture, all of which are critical for diagnosis. However, existing DPMs operate in noisy latent spaces that lack semantic structure and strong priors, making it difficult to ensure meaningful control over generated content. To address this, we propose graph-based object-level representations for Graph-Conditioned-Diffusion. Our approach generates graph nodes corresponding to each major structure in the image, encapsulating their individual features and relationships. These graph representations are processed by a transformer module and integrated into a diffusion model via the text-conditioning mechanism, enabling fine-grained control over generation. We evaluate this approach using a real-world histopathology use case, demonstrating that our generated data can reliably substitute for annotated patient data in downstream segmentation tasks. The code is available here.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑