arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2504.03600eess.IVcs.AIcs.CV

MedSAM2:在3D医学图像和视频中分割任何物体

MedSAM2: Segment Anything in 3D Medical Images and Videos

University Health Network(多伦多大学健康网络);Vector Institute(向量研究院);Harvard Medical School(哈佛医学院);Harvard University(哈佛大学);University of Toronto(多伦多大学);Peter Munk Cardiac Centre(彼得·芒克心脏中心);AI Hub(人工智能中心)

Jun Ma, Zongxin Yang, Sumin Kim, Bihui Chen, Mohammed Baharoon, Adibvafa Fallahpour, Reza Asakereh, Hongwei Lyu, Bo Wang

AI总结:

提出MedSAM2,通过微调Segment Anything Model 2构建3D医学图像和视频分割基础模型,结合人在回路流程显著降低标注成本并提升分割性能。

摘要:

医学图像和视频分割是精准医学的关键任务,在为2D图像开发特定任务或模态以及通用模型方面已取得显著进展。然而,针对3D图像和视频构建通用模型并进行全面用户研究的有限。在此,我们提出MedSAM2,一个用于3D图像和视频分割的可提示分割基础模型。该模型通过在包含超过455,000个3D图像-掩码对和76,000帧的大型医学数据集上微调Segment Anything Model 2开发而成,在广泛的器官、病灶和成像模态上超越了先前模型。此外,我们实现了人在回路的流程以促进大规模数据集创建,据我们所知,这是迄今最广泛的用户研究,涉及5,000个CT病灶、3,984个肝脏MRI病灶和251,550个超声心动图视频帧的标注,证明MedSAM2能将人工成本降低超过85%。MedSAM2还集成到广泛使用的平台中,具备用于本地和云端部署的友好界面,使其成为支持研究和医疗环境中高效、可扩展和高质量分割的实用工具。

英文摘要:

Medical image and video segmentation is a critical task for precision medicine, which has witnessed considerable progress in developing task or modality-specific and generalist models for 2D images. However, there have been limited studies on building general-purpose models for 3D images and videos with comprehensive user studies. Here, we present MedSAM2, a promptable segmentation foundation model for 3D image and video segmentation. The model is developed by fine-tuning the Segment Anything Model 2 on a large medical dataset with over 455,000 3D image-mask pairs and 76,000 frames, outperforming previous models across a wide range of organs, lesions, and imaging modalities. Furthermore, we implement a human-in-the-loop pipeline to facilitate the creation of large-scale datasets resulting in, to the best of our knowledge, the most extensive user study to date, involving the annotation of 5,000 CT lesions, 3,984 liver MRI lesions, and 251,550 echocardiogram video frames, demonstrating that MedSAM2 can reduce manual costs by more than 85%. MedSAM2 is also integrated into widely used platforms with user-friendly interfaces for local and cloud deployment, making it a practical tool for supporting efficient, scalable, and high-quality segmentation in both research and healthcare environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑