Medical SAM3: A Foundation Model for Universal Prompt-Driven Medical Image Segmentation
University of Central Florida, Orlando, USA(佛罗里达大学);University College London, London, UK(伦敦大学学院);University of Illinois Urbana-Champaign, Champaign, USA(伊利诺伊大学厄巴纳-香槟分校);University of Trento, Trento, Italy(特伦托大学);The Hong Kong Polytechnic University, China(香港理工大学);University of Pennsylvania, Philadelphia, USA(宾夕法尼亚大学)
Promptable segmentation foundation models such as SAM3 have demonstrated strong generalization capabilities through interactive and concept-based prompting. However, their direct applicability to medical image segmentation remains limited by severe domain shifts, the absence of privileged spatial prompts, and the need to reason over complex anatomical and volumetric structures. Here we present Medical SAM3, a foundation model for universal prompt-driven medical image segmentation, obtained by fully fine-tuning SAM3 on large-scale, heterogeneous 2D and 3D medical imaging datasets with paired segmentation masks and text prompts. Through a systematic analysis of vanilla SAM3, we observe that its performance degrades substantially on medical data, with its apparent competitiveness largely relying on strong geometric priors such as ground-truth-derived bounding boxes. These findings motivate full model adaptation beyond prompt engineering alone. By fine-tuning SAM3's model parameters on 33 datasets spanning 10 medical imaging modalities, Medical SAM3 acquires robust domain-specific representations while preserving prompt-driven flexibility. Extensive experiments across organs, imaging modalities, and dimensionalities demonstrate consistent and significant performance gains, particularly in challenging scenarios characterized by semantic ambiguity, complex morphology, and long-range 3D context. Our results establish Medical SAM3 as a universal, text-guided segmentation foundation model for medical imaging and highlight the importance of holistic model adaptation for achieving robust prompt-driven segmentation under severe domain shift. Code and model will be made available at https://github.com/AIM-Research-Lab/Medical-SAM3.
Medical Visual Prompting (MVP): A Unified Framework for Versatile and High-Quality Medical Image Segmentation
School of Automation, Guangdong University of Technology(广东工业大学自动化学院);School of Computer Science and Technology, Guangdong University of Technology(广东工业大学计算机科学与技术学院);School of Information Science and Technology, Guangdong University of Foreign Studies(广东外语外贸大学信息科学与技术学院);Faculty of Science and Technology, University of Macau(澳门大学科技学院);The First Affiliated Hospital of Sun Yat-Sen University(中山大学附属第一医院);Sun Yat-sen University Cancer Center(中山大学肿瘤防治中心);South China Hospital, Shenzhen University(深圳大学华南医院)
Intelligent Communication Mixture-of-Experts Boosted-Medical Image Segmentation Foundation Model
College of Optoelectronics Engineering, Chongqing University, Chongqing, China;Center of Digital Dentistry, Peking University School;Hospital of Stomatology \& NHC Key Laboratory of Digital Stomatology, Beijing, China
Hierarchical Self-Prompting SAM: A Prompt-Free Medical Image Segmentation Framework
State Key Laboratory of Multimodal Artificial Intelligence System, Institute of Automation, Chinese Academy of Science, China(多模态人工智能系统国家重点实验室,自动化研究所,中国科学院,中国);School of Artificial Intelligence, University of Chinese Academy of Science, China(人工智能学院,中国科学院大学,中国);Department of Radiology, Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing(放射科,北医三院,北京医科大学,中国医学科学院,北京)
Enhancing the Reliability of Segment Anything Model for Auto-Prompting Medical Image Segmentation with Uncertainty Rectification
Artificial Intelligence Innovation and Incubation Institute, Fudan University(复旦大学人工智能创新与孵化研究院);Shanghai Academy of Artificial Intelligence for Science(上海科学人工智能研究院)
From Adaptation to Generalization: Adaptive Visual Prompting for Medical Image Segmentation
Technical University of Munich(慕尼黑技术大学);Korea University(韩国大学);Kyung Hee University(庆熙大学);Seoul National University of Science and Technology(首尔科学技术大学)
Temporally-Extended Prompts Optimization for SAM in Interactive Medical Image Segmentation
East China Normal University(华东师范大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳人工智能与机器人研究院);Shanghai Jiao Tong University(上海交通大学)
Robust Box Prompt based SAM for Medical Image Segmentation
National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Medical School, Shenzhen University(深圳大学医学院生物医学工程学院国家区域医学超声关键技术工程实验室);Shenzhen University(深圳大学);Shenzhen RayShape Medical Technology Co., Ltd(深圳睿形医疗科技有限公司);First Affiliated Hospital, Southern University of Science and Technology, Shenzhen People’s Hospital(南方科技大学第一附属医院(深圳市人民医院))
Cross Prompting Consistency with Segment Anything Model for Semi-supervised Medical Image Segmentation
The Chinese University of Hong Kong(香港中文大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Institute of Medical Intelligence and XR, The Chinese University of Hong Kong(香港中文大学医学智能与XR研究所)
提出 CPC-SAM,在双分支框架中通过 SAM 交叉提示和提示一致性正则化利用标注与未标注数据,显著提升半监督医学图像分割性能。
DEAP-3DSAM: Decoder Enhanced and Auto Prompt SAM for 3D Medical Image Segmentation
College of Computer Science and Tech.(计算机科学与技术学院);National University of Defense Tech.(国防科技大学);Department of GI Medical Onco.(胃肠医学肿瘤科);TMUCIH, NCRCC(TMUCIH、NCRCC)
Learnable Prompting SAM-induced Knowledge Distillation for Semi-supervised Medical Image Segmentation
School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);Institute of High-Performance Computing, Agency for Science, Technology and Research(新加坡科技研究局高性能计算研究所);School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院)
Prompting Segment Anything Model with Domain-Adaptive Prototype for Generalizable Medical Image Segmentation
National Engineering Research Center for Multimedia Software(国家多媒体软件工程技术研究中心);Medical Artificial Intelligence Research Institute of Renmin Hospital, Wuhan University(武汉大学人民医院医学人工智能研究院);School of Computer Science, Central China Normal University(华中师范大学计算机学院)
Each Test Image Deserves A Specific Prompt: Continual Test-Time Adaptation for 2D Medical Image Segmentation
School of Computer Science and Engineering, Northwestern Polytechnical University(西北工业大学计算机科学与工程学院);Research & Development Institute of Northwestern Polytechnical University in Shenzhen(西北工业大学深圳研究院);Ningbo Institute of Northwestern Polytechnical University(西北工业大学宁波研究院)
Multi-rater Prompting for Ambiguous Medical Image Segmentation
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Institute of Wenzhou, Zhejiang University(浙江大学温州研究院);State Key Laboratory of Transvascular Implantation Devices of The Second Affiliated Hospital, Zhejiang University School of Medicine(浙江大学医学院第二附属医院血管植入装置国家重点实验室);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Notre Dame(圣母大学);School of Public Health Zhejiang University(浙江大学公共卫生学院)
EEMS: Edge-Prompt Enhanced Medical Image Segmentation Based on Learnable Gating Mechanism
School of Advanced Manufacturing, Guangdong University of Technology(广东技术大学先进制造学院);Department of Cardiology, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China(广东省人民医院心内科(广东省医学科学院));College of Automation, Nanjing University of Posts and Telecommunications, Nanjing, China(南京邮电大学自动化学院)
Neural networks pre-trained on a self-supervision scheme have become the standard when operating in data rich environments with scarce annotations. As such, fine-tuning a model to a downstream task in a parameter-efficient but effective way, e.g. for a new set of classes in the case of semantic segmentation, is of increasing importance. In this work, we propose and investigate several contributions to achieve a parameter-efficient but effective adaptation for semantic segmentation on two medical imaging datasets. Relying on the recently popularized prompt tuning approach, we provide a prompt-a…
FedLPPA: Learning Personalized Prompt and Aggregation for Federated Weakly-supervised Medical Image Segmentation
Southern University of Science and Technology (SUSTech)(南方科技大学);Jiaxing Research Institute, Southern University of Science and Technology(南方科技大学嘉兴研究院);the University of Hong Kong(香港大学);the Hong Kong University of Science and Technology(香港科技大学)
STPNet: Scale-aware Text Prompt Network for Medical Image Segmentation
Xiamen University(厦门大学);University of Washington(华盛顿大学);UT Southwestern Medical Center(西南大学医学中心);University of Hull(赫尔大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Are foundation models efficient for medical image segmentation?
University of California, San Francisco(加州大学旧金山分校);Bakar Computational Health Sciences Institute(巴卡尔计算健康科学研究所);UCSF-UC Berkeley Joint Program in Computational Precision Health(加州大学旧金山分校-加州大学伯克利分校计算精准健康联合项目);Center for Intelligent Imaging(智能成像中心)