SQA-SAM: Segmentation Quality Assessment for Medical Images Utilizing the Segment Anything Model
Nanjing University of Science and Technology（南京理工大学）；Digital Medical Research Center, School of Basic Medical Sciences, Fudan University（复旦大学基础医学院数字医学研究中心）；The Chinese University of Hong Kong（香港中文大学）；University of Notre Dame（圣母大学）
Yizhe Zhang, Shuo Wang, Tao Zhou, Qi Dou, Danny Z. Chen
Segmentation quality assessment (SQA) plays a critical role in the deployment of a medical image based AI system. Users need to be informed/alerted whenever an AI system generates unreliable/incorrect predictions. With the introduction of the Segment Anything Model (SAM), a general foundation segmentation model, new research opportunities emerged in how one can utilize SAM for medical image segmentation. In this paper, we propose a novel SQA method, called SQA-SAM, which exploits SAM to enhance the accuracy of quality assessment for medical image segmentation. When a medical image segmentation model (MedSeg) produces predictions for a test image, we generate visual prompts based on the predictions, and SAM is utilized to generate segmentation maps corresponding to the visual prompts. How well MedSeg's segmentation aligns with SAM's segmentation indicates how well MedSeg's segmentation aligns with the general perception of objectness and image region partition. We develop a score measure for such alignment. In experiments, we find that the generated scores exhibit moderate to strong positive correlation (in Pearson correlation and Spearman correlation) with Dice coefficient scores reflecting the true segmentation quality.
Segment Anything Model (SAM) for Radiation Oncology
Mayo Clinic（梅奥诊所）；University of Georgia（佐治亚大学）；The University of Texas at Arlington（德克萨斯大学阿灵顿分校）；Massachusetts General Hospital（麻省总医院）；Harvard Medical School（哈佛医学院）
SAM3D: Segment Anything Model in Volumetric Medical Images
University of Arkansas（阿肯色大学）；University of Science, Vietnam National University（越南国家大学科学大学）；John von Neumann Institute, Vietnam National University（越南国家大学约翰·冯·诺依曼研究所）；West Virginia University（西弗吉尼亚大学）；University of Arkansas for Medical Sciences（阿肯色医科大学）
Segment Anything in Medical Images and Videos: Benchmark and Deployment
Peter Munk Cardiac Centre, University Health Network（彼得·芒克心脏中心，大学健康网络）；Vector Institute for Artificial Intelligence（向量人工智能研究所）；AI Hub, University Health Network（人工智能中心，大学健康网络）；University of Toronto（多伦多大学）
本文对 SAM2 在 11 种医学图像模态和视频上进行了全面基准测试，并通过微调迁移学习及 3D Slicer 插件和 Gradio API 部署，验证了其快速适应医学领域并实现高效 3D 分割的能力。
Encoding Structural Constraints into Segment Anything Models via Probabilistic Graphical Models
The George Washington University（乔治·华盛顿大学）；Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（深圳先进技术研究所，中国科学院）；University of Alabama at Birmingham（阿拉巴马大学伯明翰分校）
NVS-SQA: Exploring Self-Supervised Quality Representation Learning for Neurally Synthesized Scenes without References
School of Computer Science, the University of Sydney（悉尼大学计算机科学学院）；School of Software, Shandong University（山东大学软件学院）；School of Computer and Artificial Intelligence, Beijing Technology and Business University（北京科技与商业大学计算机与人工智能学院）
Improving Segment Anything on the Fly: Auxiliary Online Learning and Adaptive Fusion for Medical Image Segmentation
School of Computer Science and Engineering, Nanjing University of Science and Technology（南京理工大学计算机科学与工程学院）；Digital Medical Research Center, School of Basic Medical Sciences, Fudan University（复旦大学基础医学院数字医学研究中心）；Shanghai Jiaotong University（上海交通大学）；the Chinese University of Hong Kong（香港中文大学）
Duke University（杜克大学）；Duke Kunshan University（昆山杜克大学）；Nicholas Institute for Energy, Environment & Sustainability, Duke University（杜克大学尼古拉斯能源、环境与可持续发展研究所）；University of Montana（蒙大拿大学）
