arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.09192cs.CV

Salt & Pepper Heatmaps:基于扩散模型的关键点检测策略

Salt & Pepper Heatmaps: Diffusion-informed Landmark Detection Strategy

University of Oxford(牛津大学)

Julian Wyatt, Irina Voiculescu

AI总结:

该研究将自动解剖关键点检测重构为生成式建模任务,利用扩散模型的随机性生成少数像素激活的热图,在MRE指标上达SOTA,SDR性能与现有工作相当。

摘要:

解剖关键点检测是识别图像关键区域以进行临床测量的过程。每个关键点都是由临床医生标记的单个真实点。机器学习模型将关键点的位置预测为以热图表示的概率区域。扩散模型因高质量采样和模式覆盖度高,在生成式建模领域日益流行,已被应用于医学图像处理的语义分割任务中。扩散建模可进一步调整以学习关键点的分布。扩散模型的随机特性能捕捉关键点预测的波动,我们通过将其模糊为有意义的概率区域来利用这一特性。本文将自动解剖关键点检测重新定义为一项精确的生成式建模任务,生成少数像素激活的热图。我们的方法在MRE指标上达到了当前最优水平,SDR性能与现有工作相当。

英文摘要:

Anatomical Landmark Detection is the process of identifying key areas of an image for clinical measurements. Each landmark is a single ground truth point labelled by a clinician. A machine learning model predicts the locus of a landmark as a probability region represented by a heatmap. Diffusion models have increased in popularity for generative modelling due to their high quality sampling and mode coverage, leading to their adoption in medical image processing for semantic segmentation. Diffusion modelling can be further adapted to learn a distribution over landmarks. The stochastic nature of diffusion models captures fluctuations in the landmark prediction, which we leverage by blurring into meaningful probability regions. In this paper, we reformulate automatic Anatomical Landmark Detection as a precise generative modelling task, producing a few-hot pixel heatmap. Our method achieves state-of-the-art MRE and comparable SDR performance with existing work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑