指定目标的分割有助于对光学相干断层扫描血管造影(OCTA)样本进行精准分析。现有分割方法通常针对2D投影目标执行,难以捕捉分割对象在3D体数据中的变化。为解决这一局限,研究采用低秩适配技术微调Segment Anything Model 2(SAM 2),使其能够在OCTA扫描层序列中追踪并分割指定对象。为推进这项工作,研究提出了帧序列中的提示点生成策略,以及用于获取视网膜血管(RV)层掩码的稀疏标注方法。该方法被命名为SAM-OCTA2,已在OCTA-500数据集上开展实验。它在常规2D en-face图像上的黄斑中心凹无血管区(FAZ)分割任务中取得了当前最优性能,并且能在扫描层序列中有效追踪局部血管。代码可在以下网址获取:https://github.com/ShellRedia/SAM-OCTA2。
英文摘要:
Segmentation of indicated targets aids in the precise analysis of optical coherence tomography angiography (OCTA) samples. Existing segmentation methods typically perform on 2D projection targets, making it challenging to capture the variance of segmented objects through the 3D volume. To address this limitation, the low-rank adaptation technique is adopted to fine-tune the Segment Anything Model (SAM) version 2, enabling the tracking and segmentation of specified objects across the OCTA scanning layer sequence. To further this work, a prompt point generation strategy in frame sequence and a sparse annotation method to acquire retinal vessel (RV) layer masks are proposed. This method is named SAM-OCTA2 and has been experimented on the OCTA-500 dataset. It achieves state-of-the-art performance in segmenting the foveal avascular zone (FAZ) on regular 2D en-face and effectively tracks local vessels across scanning layer sequences. The code is available at: https://github.com/ShellRedia/SAM-OCTA2.
SAM3-UNet: Simplified Adaptation of Segment Anything Model 3
Sun Yat-sen University(中山大学);Jiangxi Normal University(江西师范大学);Hainan University(海南大学);Dalian University of Technology(大连理工大学);Chizhou University(池州学院);Wuhan University(武汉大学)
Nanyang Technological University(南洋理工大学);SenseTime Research(商汤科技研究院);Carnegie Mellon University(卡内基梅隆大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
SAMJ: Fast Image Annotation on ImageJ/Fiji via Segment Anything Model
Bioengineering Department(生物工程系);Universidad Carlos III de Madrid(卡洛斯三世大学);Instituto de Investigación Sanitaria Gregorio Marañón(Gregorio Marañón卫生研究院);Institut Pasteur, Université Paris Cité(巴黎研究院);University of Wisconsin(威斯康星大学);University of La Rioja(拉里奥ja大学);VSB – Technical University of Ostrava(奥斯特拉瓦技术大学);Masaryk University(马萨里克大学);MRC Laboratory of Molecular Biology(分子生物学实验室);University of Cambridge(剑桥大学);Donostia International Physics Center (DIPC)(Donostia国际物理中心);CNRS UMR 3691;Ecole Polytechnique Fédérale de Lausanne (EPFL)(洛桑联邦理工学院)
AI-SAM: Automatic and Interactive Segment Anything Model
The Pennsylvania State University(宾夕法尼亚州立大学);Huck Institutes of the Life Sciences(哈克生命科学研究所);Northwestern Memorial Hospital(西北纪念医院);Northwestern University(西北大学)
Biomedical SAM 2: Segment Anything in Biomedical Images and Videos
University of Georgia(佐治亚大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Lehigh University(理海大学);Northeastern University(东北大学);University of Notre Dame(圣母大学)
On Efficient Variants of Segment Anything Model: A Survey
School of Computer Science and Engineering(计算机科学与工程学院);School of Computing and Communications(计算与通信学院);School of Computer Science and Technology(计算机科学与技术学院)
SAMamba3D: adapting Segment Anything for generalizable 3D segmentation of multiphase pore-scale images
Department of Earth Science and Engineering, Imperial College London(帝国理工学院伦敦地球科学与工程系);College of Artificial Intelligence, China University of Petroleum (Beijing)(中国石油大学(北京)人工智能学院);College of Petroleum Engineering, China University of Petroleum (Beijing)(中国石油大学(北京)石油工程学院)
SAMRS: Scaling-up Remote Sensing Segmentation Dataset with Segment Anything Model
Wuhan University(武汉大学);The University of Sydney(悉尼大学);National Engineering Research Center of Speech and Language Information Processing(国家语音及语言信息处理工程技术研究中心)
A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineering
Kyung Hee University(庆熙大学);Beijing Institue of Technology(北京理工大学);KAIST(韩国科学技术院);Microsoft STCA(微软STCA);Harbin Institute of Technology(哈尔滨工业大学);The State University of New York - SUNY(纽约州立大学);Hong Kong Polytechnic University(香港理工大学)
本文综述了 Meta 的 SAM 及 SAM 2 模型,分析其在图像和视频分割中的能力、局限与未来方向,重点关注高粒度分割和提示缺失场景。
Segment Anything Model Can Not Segment Anything: Assessing AI Foundation Model's Generalizability in Permafrost Mapping
Arizona State University(亚利桑那州立大学);Woodwell Climate Research Center(伍德韦尔气候研究中心);University of Connecticut(康涅狄格大学);U.S. Geological Survey(美国地质调查局);University of California, Santa Barbara(加利福尼亚大学圣巴巴拉分校);University of Illinois at Urbana-Champaign(伊利诺伊大学香槟分校)
本文评估了以 Meta SAM 为代表的视觉基础模型在永久冻土地貌分割中的表现,通过多种提示策略和微调测试其零样本能力与领域适应性,并指出其在挑战性地理空间任务中仍需改进。