arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2505.06527cs.CVcs.AI

提升医学图像配准基础模型的泛化能力

Improving Generalization of Medical Image Registration Foundation Model

Chengdu University of Information Technology(成都信息学院);Purdue University(普渡大学);University at Albany, State University of New York(纽约州立大学阿尔巴尼分校)

Jing Hu, Kaiwei Yu, Hongjiang Xian, Shu Hu, Xin Wang

AI总结:

本文针对医学图像配准基础模型在新解剖结构、成像条件和模态下泛化不足的问题,引入SAM优化损失景观平坦度,显著提升跨数据集配准的鲁棒性与性能。

摘要:

可变形配准是医学图像处理中的一项基础任务,旨在通过在图像之间建立非线性对应关系来实现精确对齐。传统方法具有良好的适应性和可解释性,但受到计算效率的限制。尽管深度学习方法显著提升了配准速度和准确性,但它们在不同数据集和任务之间往往缺乏灵活性和泛化能力。近年来,基础模型成为一个有前景的方向,其利用大规模、多样化数据集学习图像配准的通用特征和变换模式,从而展现出较强的跨任务迁移能力。然而,当遇到新的解剖结构、变化的成像条件或未见过的模态时,这些模型在泛化性和鲁棒性方面仍面临挑战。为解决这些局限,本文将 Sharpness-Aware Minimization(SAM,锐度感知最小化)引入基础模型,以增强其在医学图像配准中的泛化性和鲁棒性。通过优化损失景观的平坦度,SAM提升了模型在多种数据分布上的稳定性,并增强了其处理复杂临床场景的能力。实验结果表明,集成SAM的基础模型在跨数据集配准性能上取得显著提升,为医学图像配准技术的发展提供了新的见解。我们的代码可在 https://github.com/Promise13/fm_sam 获取。

英文摘要:

Deformable registration is a fundamental task in medical image processing, aiming to achieve precise alignment by establishing nonlinear correspondences between images. Traditional methods offer good adaptability and interpretability but are limited by computational efficiency. Although deep learning approaches have significantly improved registration speed and accuracy, they often lack flexibility and generalizability across different datasets and tasks. In recent years, foundation models have emerged as a promising direction, leveraging large and diverse datasets to learn universal features and transformation patterns for image registration, thus demonstrating strong cross-task transferability. However, these models still face challenges in generalization and robustness when encountering novel anatomical structures, varying imaging conditions, or unseen modalities. To address these limitations, this paper incorporates Sharpness-Aware Minimization (SAM) into foundation models to enhance their generalization and robustness in medical image registration. By optimizing the flatness of the loss landscape, SAM improves model stability across diverse data distributions and strengthens its ability to handle complex clinical scenarios. Experimental results show that foundation models integrated with SAM achieve significant improvements in cross-dataset registration performance, offering new insights for the advancement of medical image registration technology. Our code is available at https://github.com/Promise13/fm_sam}{https://github.com/Promise13/fm\_sam.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑