LUMOS: Latent Universal Medical Priors for Segmentation
The University of Sydney, Sydney. NSW 2006, Australia Biological System \& Engineering Division, Lawrence Berkeley National Laboratory, Berkeley. CA 94720, USA Berkeley Biomedical Data Science Center, Lawrence Berkeley National Laboratory, Berkeley. CA 94720, USA
Zhuonan Liang, Wei Guo, Jie Gan, Yaxuan Song, Runnan Chen, Hang Chang, Weidong Cai
General vision foundation models (VFMs) have been primarily developed on natural images, and their utility for medical image segmentation is therefore often considered to depend on costly adaptation or domain-specific fine-tuning. In this paper, we revisit this assumption from a different perspective: rather than requiring VFM segmentors to relearn visual regularities, we investigate whether the low-level visual priors necessary for anatomical delineation already lie dormant within general VFMs. We observe that frozen VFMs, despite lacking medical supervision, encode transferable visual regularities. These properties are not exclusive to natural images but are also fundamental to medical image understanding. Motivated by this observation, we propose Latent Universal Medical PriOrs for Segmentation (LUMOS), a novel framework that amplifies general VFM priors to conventional medical segmentors. LUMOS consists of two key components: (1) Pathfinder that distills visual cues from a frozen vision foundation model, and (2) Inspiror that sparks the conventional medical networks with spatial guidance from distilled visual regularities. In this way, the segmentor is relieved from learning complex visual regularities entirely from limited medical annotations and can instead focus on task-specific anatomical delineation. Across diverse medical datasets and token-based VFMs, LUMOS shows that general VFMs can serve as spatial prior generators when their frozen token spaces preserve patch-level pattern relevance. DINO provides stable matched-backbone gains, while SigLIP exposes VFM-specific sensitivity caused by its different token granularity and representation objective.
LEAF: Latent Diffusion with Efficient Encoder Distillation for Aligned Features in Medical Image Segmentation
School of Computer Science and Engineering, Sun Yat-sen University, China(计算机科学与工程学院,中山大学);Department of Biomedical Engineering, Johns Hopkins University, United States(生物医学工程系,约翰霍普金斯大学)
Diversified and Personalized Multi-rater Medical Image Segmentation
University of Electronic Science and Technology of China(电子科技大学);The Chinese University of Hong Kong(香港中文大学);University of Oxford(牛津大学);Monash University(莫纳什大学)
L2GNet: Optimal Local-to-Global Representation of Anatomical Structures for Generalized Medical Image Segmentation
Northwestern University(西北大学);Beth Israel Lahey Health, University of Massachusetts Chan School of Medicine(马萨诸塞大学陈医学院贝斯以色列拉希医疗中心);TCS Research(塔塔咨询服务研究中心);University of South Dakota(南达科他大学)
Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Models
Zhejiang University(浙江大学);DAMO Academy, Alibaba Group(阿里云达摩院);Hupan Lab(虎扑实验室);National University of Singapore(新加坡国立大学);Hong Kong University of Science and Technology(香港科技大学);Fudan University(复旦大学);Tsinghua University(清华大学)
CRISP - Reliable Uncertainty Estimation for Medical Image Segmentation
University of Sherbrooke(舍布鲁克大学);University of Lyon(里昂大学);CREATIS(CREATIS实验室);CNRS(法国国家科学研究中心);Inserm(法国国家健康与医学研究院);INSA-Lyon(里昂国立应用科学学院);University of Lyon 1(里昂第一大学);Ultromics Ltd.(Ultromics有限公司)
Diffusion-Based Data Augmentation for Medical Image Segmentation
School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);Dept. of Engineering for Innovation Medicine, University of Verona(威尼斯大学创新医学工程系)
MNet: Rethinking 2D/3D Networks for Anisotropic Medical Image Segmentation
Southeast University(东南大学);Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing(江苏省医学信息处理联合国际研究实验室);Centre de Recherche en Information Biomédicale Sino-Français (CRIBs)(中法生物医学信息研究中心(CRIBs))
厚切片扫描的性质导致3D医学图像的严重切片间不连续性,并且vanilla 2D/3D卷积神经网络(CNN)无法以平衡的方式表示稀疏的切片间信息和密集的切片内信息,导致严重的切片间特征欠拟合(对于vanilla 2D CNN)和过度拟合来自远程切片的噪声(对于vanilla 3D CNN)。在这项工作中,提出了一种新的网状网(MNet),通过学习来平衡轴间的空间表示。1)我们的MNet通过将多维卷积深度嵌入基本模块,潜在地融合了大量的表示过程,使得表示过程的选择灵活,从而自适应地平衡稀疏切片间信息和密集切片内信息的表示。2)我们的MNet潜在地融合了每个基本模块内部的多维特征,同时利用2D(2D视图中易于识别的区域的高分割精度)和3D(3D器官轮廓的高平滑度)表示的优势,从而获得更准确的目标区域建模。在四个公共数据集(CT\&MR)上进行了综合实验,实验结果一致表明所提出的MNet方法优于其他方法.代码和数据集可在以下网址获得:https://github.com/zfdong-code/MNet
Consistent View Alignment Improves Foundation Models for 3D Medical Image Segmentation
Department of Applied Mathematics, Technical Medical Centre, University of Twente(代尔夫特理工大学应用数学系);Digital Technology and Innovation, Siemens Healthineers, Erlangen, Germany(西门子医疗创新部,埃尔朗根,德国)
Decomposing Normal and Abnormal Features of Medical Images into Discrete Latent Codes for Content-Based Image Retrieval
National Cancer Center Research Institute(国立癌症中心研究所);RIKEN Center for Advanced Intelligent Project(理化学研究所先进智能项目中心);The University of Tokyo(东京大学);National Cancer Center Hospital(国立癌症中心医院)
Latents of latents to delineate pixels: hybrid Matryoshka autoencoder-to-U-Net pairing for segmenting large medical images in GPU-poor and low-data regimes
School of Mathematics and Computer Science, Institute of Business Administration(商业管理学院数学与计算机科学学院)
SeLoRA: Self-Expanding Low-Rank Adaptation of Latent Diffusion Model for Medical Image Synthesis
University of Edinburgh(爱丁堡大学);Harvard Medical School(哈佛医学院);Heriot-Watt University(赫瑞瓦特大学);Imperial College London(伦敦帝国学院);Athena Research Centre(雅典娜研究中心)
All-in-One Medical Image Restoration with Latent Diffusion-Enhanced Vector-Quantized Codebook Prior
School of Biological Science and Medical Engineering(生物科学与医学工程学院);State Key Laboratory of Software Development Environment(软件开发环境国家重点实验室);Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education(教育部生物力学与机械生物学重点实验室);Beijing Advanced Innovation Center for Biomedical Engineering(北京生物医学工程先进创新中心);Beihang University(北京航空航天大学);Department of Biomedical Engineering(生物医学工程系);Tsinghua University(清华大学);ByteDance Inc.(字节跳动公司)
VITAL: Visual-Semantic Dual Supervision for Enhanced and Interpretable Latent Reasoning in Medical MLLMs
Zhejiang University(浙江大学);Shanghai AI Laboratory(上海人工智能实验室);Tencent(腾讯);Ningbo Global Innovation Center, Zhejiang University(宁波全球创新中心,浙江大学);Zhejiang Key Laboratory of Digital-Intelligence Service Technology(浙江省数字智能服务技术重点实验室)
Latent Diffusion Autoencoders: Toward Efficient and Meaningful Unsupervised Representation Learning in Medical Imaging
Department of Electrical and Information Engineering (DIEI), University of Cassino and Southern Lazio(电气与信息工程系(DIEI),卡斯诺和南部拉齐亚大学);Diagnostic Image Analysis Group, Radboud University Medical Center(影像诊断分析组,拉德堡德大学医学中心);Department of Medical Imaging, Radboud University Medical Center(医学成像系,拉德堡德大学医学中心)
MedLVR: Latent Visual Reasoning for Reliable Medical Visual Question Answering
Department of Radiation Oncology and Winship Cancer Institute, Emory University School of Medicine(埃默里大学医学院放射肿瘤学系与温希普癌症研究所);Department of Biostatistics and Bioinformatics, Emory University(埃默里大学生物统计学与生物信息学系)
Investigating Data Memorization in 3D Latent Diffusion Models for Medical Image Synthesis
Heidelberg University Hospital(海德堡大学医院);German Centre for Cardiovascular Research(德国心血管研究中心);Heidelberg University(海德堡大学);University Medical Center Mannheim(曼海姆大学医学中心)
EchoFlow: A Foundation Model for Cardiac Ultrasound Image and Video Generation
Imperial College London(帝国理工学院);University of Birmingham(伯明翰大学);Ultromics Ltd.(奥特罗米克斯有限公司);University of Oxford(牛津大学);Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学)