arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.08046cs.CVcs.AI

ProSona:用于多专家医学图像分割的提示引导个性化

ProSona: Prompt-Guided Personalization for Multi-Expert Medical Image Segmentation

University Hospital Bonn(波恩大学医院);LMU University Hospital(慕尼黑莱茵河医学院医院);University Hospital Düsseldorf(杜伊斯堡大学医院);Heidelberg University Hospital(海德堡大学医院);Università Cattolica del Sacro Cuore(罗马天主教圣心大学);University Hospital Zurich(苏黎世大学医院);Bavarian Cancer Research Center (BZKF)(巴伐利亚癌症研究中心);DTU Compute(技术大学计算学院);Helmholtz AI(海德堡中心人工智能)
Aya Elgebaly, Nikolaos Delopoulos, Juliane Hörner-Rieber, Carolin Rippke, Sebastian Klüter, Luca Boldrini, Lorenzo Placidi, Riccardo Dal Bello, Nicolaus Andrats… 展开作者

Aya Elgebaly, Nikolaos Delopoulos, Juliane Hörner-Rieber, Carolin Rippke, Sebastian Klüter, Luca Boldrini, Lorenzo Placidi, Riccardo Dal Bello, Nicolaus Andratschke, Michael Baumgartl, Claus Belka, Christopher Kurz, Guillaume Landry, Shadi Albarqouni

AI总结:

针对医学图像分割中专家间标注差异问题,提出 ProSona 两阶段框架,通过学习标注风格的连续潜在空间,结合自然语言提示引导投影机制生成个性化分割,在两个数据集上较 DPersona 性能显著提升。

摘要:

自动化医学图像分割存在较高的观察者间变异性,尤其在肺结节 delineation 等任务中,专家意见常不一致。现有方法要么将这种变异性压缩为共识掩码,要么为每个标注者依赖单独的模型分支。我们引入 ProSona,一个两阶段框架,学习标注风格的连续潜在空间,通过自然语言提示实现可控个性化。概率 U-Net 骨干捕获多样专家假设,提示引导的投影机制导航该潜在空间生成个性化分割。多级对比目标对齐文本和视觉表示,促进解耦且可解释的专家风格。在 LIDC-IDRI 肺结节和多机构前列腺 MRI 数据集上,ProSona 较 DPersona 降低 17% 广义能量距离,平均 Dice 提升超 1 个百分点。这些结果表明,自然语言提示可为个性化医学图像分割提供灵活、准确且可解释的控制。我们的实现已在线公开。

英文摘要:

Automated medical image segmentation suffers from high inter-observer variability, particularly in tasks such as lung nodule delineation, where experts often disagree. Existing approaches either collapse this variability into a consensus mask or rely on separate model branches for each annotator. We introduce ProSona, a two-stage framework that learns a continuous latent space of annotation styles, enabling controllable personalization via natural language prompts. A probabilistic U-Net backbone captures diverse expert hypotheses, while a prompt-guided projection mechanism navigates this latent space to generate personalized segmentations. A multi-level contrastive objective aligns textual and visual representations, promoting disentangled and interpretable expert styles. Across the LIDC-IDRI lung nodule and multi-institutional prostate MRI datasets, ProSona reduces the Generalized Energy Distance by 17% and improves mean Dice by more than one point compared with DPersona. These results demonstrate that natural-language prompts can provide flexible, accurate, and interpretable control over personalized medical image segmentation. Our implementation is available online 1 .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑