Topology-Driven Transferability Estimation of Medical Foundation Models for Segmentation
Peking University(北京大学);Hohai University(河海大学);Beijing Normal University-Hong Kong Baptist University United International College(北京师范大学-香港 Baptist大学联合国际学院);National Institute of Health Data Science, Peking University(健康数据科学国家研究院,北京大学);Institute of Medical Technology, Peking University(北京大学医学技术研究院);State Key Laboratory of General Artificial Intelligence, Peking University(通用人工智能国家重点实验室,北京大学)
The advent of large-scale self-supervised learning (SSL) has produced a vast zoo of medical foundation models. However, selecting optimal medical foundation models for specific segmentation tasks remains a computational bottleneck. Existing Transferability Estimation (TE) metrics, primarily designed for classification, rely on global statistical assumptions and fail to capture the topological complexity essential for dense prediction. We propose a novel Topology-Driven Transferability Estimation framework that evaluates manifold tractability rather than statistical overlap. Our approach introduces three components: (1) Global Representation Topology Divergence (GRTD), utilizing Minimum Spanning Trees to quantify feature-label structural isomorphism; (2) Local Boundary-Aware Topological Consistency (LBTC), which assesses manifold separability specifically at critical anatomical boundaries; and (3) Task-Adaptive Fusion, which dynamically integrates global and local metrics based on the semantic cardinality of the target task. Validated on the large-scale OpenMind benchmark across diverse anatomical targets and SSL foundation models, our approach significantly outperforms state-of-the-art baselines by around 31% relative improvement in the weighted Kendall metric, providing a robust, training-free proxy for efficient model selection without the cost of fine-tuning. The code will be made publicly available upon acceptance.
Intelligent Communication Mixture-of-Experts Boosted-Medical Image Segmentation Foundation Model
College of Optoelectronics Engineering, Chongqing University, Chongqing, China;Center of Digital Dentistry, Peking University School;Hospital of Stomatology \& NHC Key Laboratory of Digital Stomatology, Beijing, China
Foundation Models in Medical Imaging: A Review and Outlook
Netherlands Cancer Institute(荷兰癌症研究所);Radboud University Medical Center(拉德堡德大学医学中心);Delft University of Technology(代尔夫特理工大学);University of Amsterdam(阿姆斯特丹大学);Oncode Institute(Oncode研究所)
Multimodal, Multi-Disease Medical Imaging Foundation Model (MerMED-FM)
Institute of High Performance Computing (IHPC), A*STAR(高性能计算研究所 (IHPC),A*STAR);Singapore National Eye Centre(新加坡全国眼科中心);Singapore Eye Research Institute(新加坡眼科研究所);Singapore General Hospital(新加坡中央医院);Duke-NUS Medical School(杜克-新加坡国立大学医学院);Singapore Health Services(新加坡保健服务)
Representation Learning of Structured Data for Medical Foundation Models
ASUS Intelligent Cloud Services (AICS)(华硕智能云服务(AICS));Imperial College London(伦敦帝国学院);University of Manchester(曼彻斯特大学);Cheng Hsin General Hospital(程新总医院);Crayon Software(克雷扬软件公司)
Topology-Driven Transferability Estimation for 3D Medical Vision Foundation Models
National Institute of Health Data Science, Peking University(北京大学健康数据科学研究所);Institute of Medical Technology, Peking University(北京大学医学技术研究所);Deepwise Co., Ltd.(深度智医科技有限公司);State Key Laboratory of General Artificial Intelligence, Peking University(北京大学通用人工智能国家重点实验室);Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所)
Implicit Modeling for Transferability Estimation of Vision Foundation Models
State Key Laboratory of Complex and Critical Software Environment, Beihang University, Beijing, China(复杂与关键软件环境国家重点实验室,北京航空航天大学);School of Computer Science and Engineering, Beihang University, Beijing, China(计算机科学与工程学院,北京航空航天大学)
Benchmarking Self-Supervised 3D Medical Vision Foundation Models and Transferability Estimation
National Institution of Health Data Science, Peking University(北京大学国家健康数据科学研究院);Institute of Medical Technology, Peking University(北京大学医学技术研究院);State Key Laboratory of General Artificial Intelligence, Peking University(北京大学通用人工智能国家重点实验室);People’s Hospital of Xinjiang Uyghur Autonomous Region(新疆维吾尔自治区人民医院);Deepwise Co., Ltd.(深睿医疗有限公司);School of Data Science, Fudan University(复旦大学数据科学学院)
SimMAT: Exploring Transferability from Vision Foundation Models to Any Image Modality
Center for Artificial Intelligence and Robotics, HKISI, CAS(中国科学院香港创新研究院人工智能与机器人中心);Princeton University(普林斯顿大学);The Hong Kong Polytechnic University(香港理工大学);The Hong Kong University of Science and Technology(香港科技大学);Nanyang Technological University(南洋理工大学);State Key Laboratory of Multimodal Artificial Intelligence Systems, CASIA(中国科学院自动化研究所多模态人工智能系统国家重点实验室)
Medical SAM3: A Foundation Model for Universal Prompt-Driven Medical Image Segmentation
University of Central Florida, Orlando, USA(佛罗里达大学);University College London, London, UK(伦敦大学学院);University of Illinois Urbana-Champaign, Champaign, USA(伊利诺伊大学厄巴纳-香槟分校);University of Trento, Trento, Italy(特伦托大学);The Hong Kong Polytechnic University, China(香港理工大学);University of Pennsylvania, Philadelphia, USA(宾夕法尼亚大学)
Medical SAM3通过微调SAM3模型,提升医学图像分割的通用提示驱动能力,解决领域偏移和复杂结构推理问题。
BioVFM-21M: Benchmarking and Scaling Self-Supervised Vision Foundation Models for Biomedical Image Analysis
Paul C. Lauterbur Research Center for Biomedical Imaging(生物医学成像保罗·劳特伯研究中心);Shenzhen Institutes of Advanced Technology(深圳先进技术研究院);Chinese Academy of Sciences(中国科学院);Pengcheng Laboratory(鹏城实验室);University of Chinese Academy of Sciences(中国科学院大学);Faculty of Applied Sciences(应用科学学院)
MedIQA: A Scalable Foundation Model for Prompt-Driven Medical Image Quality Assessment
Faculty of Applied Sciences, Macao Polytechnic University, Macao, China(澳门理工学院);Department of Engineer Science, University of Oxford, Oxford, UK(牛津大学工程科学系);Great Bay University, Dongguan, China(东莞大湾大学);College of Physics and Information Engineering, Fuzhou University, Fuzhou, China(福州大学物理与信息工程学院);Shanghai Jiao Tong University, Shanghai, China(上海交通大学);Department of Radiology, Shenzhen People’s Hospital, Shenzhen, China(深圳人民医院放射科)
Adversarial Attack Vulnerability of Medical Image Analysis Systems: Unexplored Factors
Erasmus MC(伊拉斯谟医学中心);Radboudumc(拉德堡德大学医学中心);Donders Institute for Brain, Cognition and Behaviour(唐德斯大脑、认知与行为研究所);Eindhoven University of Technology(埃因霍温理工大学);Intel Corporation(英特尔公司)
The Era of Foundation Models in Medical Imaging is Approaching : A Scoping Review of the Clinical Value of Large-Scale Generative AI Applications in Radiology
Navigating Data Scarcity using Foundation Models: A Benchmark of Few-Shot and Zero-Shot Learning Approaches in Medical Imaging
Cluster of Excellence “Machine Learning”(卓越集群“机器学习”);University of Tübingen(蒂宾根大学);Faculty of Health Sciences and Medicine, University of Lucerne(卢塞恩大学健康科学与医学院)
Rethinking Foundation Models for Medical Image Classification through a Benchmark Study on MedMNIST
University of Oxford(牛津大学);Nuffield Department of Population Health, University of Oxford(牛津大学纳菲尔德人口健康系);Big Data Institute, University of Oxford(牛津大学大数据研究所)
Text-guided Foundation Model Adaptation for Long-Tailed Medical Image Classification
Southern University of Science and Technology(南方科技大学);The University of Hong Kong(香港大学);University of British Columbia(不列颠哥伦比亚大学);Jiaxing Research Institute, Southern University of Science and Technology(南方科技大学嘉兴研究院)
Enhancing Representation in Medical Vision-Language Foundation Models via Multi-Scale Information Extraction Techniques
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Peng Cheng Laboratory(鹏城实验室);University of Chinese Academy of Sciences(中国科学院大学);The University of Hong Kong(香港大学);Pazhou Laboratory (Huangpu)(琶洲实验室(黄埔))
AutoMiSeg: Automatic Medical Image Segmentation via Test-Time Adaptation of Foundation Models
Carnegie Mellon University(卡内基梅隆大学);Brown University(布朗大学);National Institute of Technology Karnataka(印度卡纳塔克国家理工学院);University of Pittsburgh(匹兹堡大学);University of Alabama at Birmingham(阿拉巴马大学伯明翰分校)