In this paper, we present PRISM, a Promptable and Robust Interactive Segmentation Model, aiming for precise segmentation of 3D medical images. PRISM accepts various visual inputs, including points, boxes, and scribbles as sparse prompts, as well as masks as dense prompts. Specifically, PRISM is designed with four principles to achieve robustness: (1) Iterative learning. The model produces segmentations by using visual prompts from previous iterations to achieve progressive improvement. (2) Confidence learning. PRISM employs multiple segmentation heads per input image, each generating a continuous map and a confidence score to optimize predictions. (3) Corrective learning. Following each segmentation iteration, PRISM employs a shallow corrective refinement network to reassign mislabeled voxels. (4) Hybrid design. PRISM integrates hybrid encoders to better capture both the local and global information. Comprehensive validation of PRISM is conducted using four public datasets for tumor segmentation in the colon, pancreas, liver, and kidney, highlighting challenges caused by anatomical variations and ambiguous boundaries in accurate tumor identification. Compared to state-of-the-art methods, both with and without prompt engineering, PRISM significantly improves performance, achieving results that are close to human levels. The code is publicly available at https://github.com/MedICL-VU/PRISM.
Towards Interactive Lesion Segmentation in Whole-Body PET/CT with Promptable Models
German Cancer Research Center (DKFZ) Heidelberg(德国癌症研究中心(DKFZ)海德堡);Division of Medical Image Computing(医学影像计算 division);HIDSS4Health - Helmholtz Information and Data Science School for Health(HIDSS4Health - 欧文信息与数据科学健康学校);Faculty of Mathematics and Computer Science(数学与计算机科学学院);Heidelberg University(海德堡大学);Helmholtz Imaging(海德堡成像);Pattern Analysis and Learning Group(模式分析与学习组);Department of Radiation Oncology(放射肿瘤科)
RadSAM: Segmenting 3D radiological images with a 2D promptable model
Raidium;Université de Paris Cité(巴黎大学);AP-HP(法国国家卫生与医学研究院);Hôpital Européen Georges Pompidou(欧仁·蓬皮杜医院);Department of Vascular and Oncological Interventional Radiology(血管和肿瘤介入放射科);HEKA INRIA;INSERM PARCC U 970(法国国家医学研究院 PARCC U 970)
SelectAnyTree: A Promptable Instance Segmentation Model for 3D Forest LiDAR Point Clouds
Nagoya University(名古屋大学);RIKEN(理化学研究所);University of Freiburg(弗莱堡大学);University of California, Los Angeles(加州大学洛杉矶分校);University of Twente(特温特大学);KC Machine Learning Lab(KC机器学习实验室);Hanoi University of Science and Technology(河内科技大学);Ritsumeikan University(立命馆大学)
Promptable Longitudinal Lesion Segmentation in Whole-Body CT
German Cancer Research Center (DKFZ) Heidelberg(德国癌症研究中心(DKFZ)海德堡);Division of Medical Image Computing(医学影像计算 division);HIDSS4Health - Helmholtz Information and Data Science School for Health(HIDSS4Health - 赫尔姆霍茨信息与数据科学健康学校);Faculty of Mathematics and Computer Science(数学与计算机科学学院);Heidelberg University(海德堡大学);Helmholtz Imaging(赫尔姆霍茨成像);Pattern Analysis and Learning Group(模式分析与学习小组);Department of Radiation Oncology(放射肿瘤科)
MOIS-SAM2: Exemplar-based Segment Anything Model 2 for multilesion interactive segmentation of neurofibromas in whole-body MRI
Institute for Applied Medical Informatics, Institute of Computational Neuroscience, and Center for Biomedical Artificial Intelligence (bAIome), University Medical Center Hamburg-Eppendorf(应用医学信息学研究所、计算神经科学研究所和生物医学人工智能中心(bAIome)、汉堡医学院中心);Department of Diagnostic and Interventional Radiology and Nuclear Medicine, University Medical Center Hamburg-Eppendorf(诊断与介入放射学及核医学系、汉堡医学院中心);Department of Neurology, University Medical Center Hamburg-Eppendorf(神经病学系、汉堡医学院中心)
MOIS-SAM2是一种基于示例的Segment Anything Model 2,用于全身体部MRI中神经纤维瘤多病灶交互分割,实现了高精度和可扩展性,支持临床应用。
AuralSAM2: Enabling SAM2 Hear Through Pyramid Audio-Visual Feature Prompting
Department of Engineering Science, University of Oxford(牛津大学工程科学系);Australian Institute for Machine Learning, Adelaide University(阿德莱德大学人工智能研究所);Stanford University(斯坦福大学);University of Central Florida(佛罗里达中央大学);University of Surrey(萨里大学)
Prompt-Guided Interactive Segmentation of Interstitial Lung Disease in Thoracic CT
University of Bern(伯尔尼大学);Graduate School for Cellular and Biomedical Sciences(细胞与生物医学科学研究生院);Bern University Hospital(伯尔尼大学医院);Lucern Cantonal Hospital(卢塞恩州立医院);Lausanne University Hospital (CHUV) and University of Lausanne(洛桑大学医院(CHUV)与洛桑大学)
AutoMiSeg: Automatic Medical Image Segmentation via Test-Time Adaptation of Foundation Models
Carnegie Mellon University(卡内基梅隆大学);Brown University(布朗大学);National Institute of Technology Karnataka(印度卡纳塔克国家理工学院);University of Pittsburgh(匹兹堡大学);University of Alabama at Birmingham(阿拉巴马大学伯明翰分校)
Interactive Test-Time Adaptation with Reliable Spatial-Temporal Voxels for Multi-Modal Segmentation
Centre for Advanced Robotics Technology Innovation (CARTIN), Nanyang Technological University(南洋理工大学先进机器人技术创新中心);Department of Electrical and Computer Engineering, National University of Singapore(新加坡国立大学电气与计算机工程系);School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电气与电子工程学院);School of Mechanical and Aerospace Engineering, Nanyang Technological University(南洋理工大学机械与航空航天工程学院)
Open ultrasound foundation model for robust segmentation and clinical measurement across heterogeneous settings
Mohamed bin Zayed Uni. of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Sheikh Tahnoon Bin Mohammed Medical City (STMC)(谢赫·塔赫农·本·穆罕默德医疗城);King’s College Hospital London - Dubai(伦敦国王学院医院迪拜分院);ADIA Lab(ADIA实验室)
Image Segmentation in Foundation Model Era: A Survey
Beijing Institute of Technology(北京理工大学);Shanghai Jiao Tong University(上海交通大学);Zhejiang University(浙江大学);ETH Zurich(苏黎世联邦理工学院);Technical University of Munich(慕尼黑工业大学)
Medical SAM3: A Foundation Model for Universal Prompt-Driven Medical Image Segmentation
University of Central Florida, Orlando, USA(佛罗里达大学);University College London, London, UK(伦敦大学学院);University of Illinois Urbana-Champaign, Champaign, USA(伊利诺伊大学厄巴纳-香槟分校);University of Trento, Trento, Italy(特伦托大学);The Hong Kong Polytechnic University, China(香港理工大学);University of Pennsylvania, Philadelphia, USA(宾夕法尼亚大学)
Medical SAM3通过微调SAM3模型,提升医学图像分割的通用提示驱动能力,解决领域偏移和复杂结构推理问题。