In the analysis of optical coherence tomography angiography (OCTA) images, the operation of segmenting specific targets is necessary. Existing methods typically train on supervised datasets with limited samples (approximately a few hundred), which can lead to overfitting. To address this, the low-rank adaptation technique is adopted for foundation model fine-tuning and proposed corresponding prompt point generation strategies to process various segmentation tasks on OCTA datasets. This method is named SAM-OCTA and has been experimented on the publicly available OCTA-500 dataset. While achieving state-of-the-art performance metrics, this method accomplishes local vessel segmentation as well as effective artery-vein segmentation, which was not well-solved in previous works. The code is available at: https://github.com/ShellRedia/SAM-OCTA.
TAPE: A two-stage parameter-efficient adaptation framework for foundation models in OCT-OCTA analysis
National Key Laboratory of Intelligent Tracking and Forecasting for Infectious Diseases（传染病智能追踪与预测国家重点实验室）；Tianjin Key Laboratory of Intelligent Robotic（天津市智能机器人重点实验室）；Institute of Robotics and Automatic Information System, Nankai University（南开大学机器人与自动化信息系统研究所）；Institute of Intelligence Technology and Robotic Systems（智能技术与机器人系统研究所）；Shenzhen Research Institute of Nankai University（南开大学深圳研究院）
Mind the Gap: Continuous Magnification Sampling for Pathology Foundation Models
Berlin Institute for the Foundations of Learning and Data (BIFOLD)（柏林学习与数据基础研究所）；Machine Learning Group, Technische Universität Berlin（柏林技术大学机器学习小组）；Aignostics（Aignostics公司）；Charité, Universitätsmedizin Berlin（柏林夏里特大学医学院）
Revisiting foundation models for cell instance segmentation
Georg-August-University Göttingen, Institute of Computer Science（哥廷根大学计算机科学学院）；CAIMed - Lower Saxony Center for AI & Causal Methods in Medicine, Göttingen（下萨克森人工智能与因果医学方法中心，哥廷根）；Cluster of Excellence Multiscale Bioimaging (MBExC), Georg-August-University Göttingen（多尺度生物成像（MBExC）集群，哥廷根大学）
Simulation-Based Segmentation of Blood Vessels in Cerebral 3D OCTA Images
University of Zurich（苏黎世大学）；ETH Zurich（苏黎世联邦理工学院）；Imperial College London（伦敦帝国学院）；Technical University of Munich（慕尼黑工业大学）；University Hospital Zurich（苏黎世大学医院）；Toronto Western Hospital（多伦多西部医院）；Krembil Research Institute（克雷比尔研究所）
Medical SAM3: A Foundation Model for Universal Prompt-Driven Medical Image Segmentation
University of Central Florida, Orlando, USA（佛罗里达大学）；University College London, London, UK（伦敦大学学院）；University of Illinois Urbana-Champaign, Champaign, USA（伊利诺伊大学厄巴纳-香槟分校）；University of Trento, Trento, Italy（特伦托大学）；The Hong Kong Polytechnic University, China（香港理工大学）；University of Pennsylvania, Philadelphia, USA（宾夕法尼亚大学）
Medical SAM3通过微调SAM3模型，提升医学图像分割的通用提示驱动能力，解决领域偏移和复杂结构推理问题。
Nanjing University of Science and Technology（南京理工大学）；The First Affiliated Hospital with Nanjing Medical University（南京医科大学第一附属医院）
Optical coherence tomography angiography (OCTA) is a novel non-invasive imaging modality that allows micron-level resolution to visualize the retinal microvasculature. The retinal vessel segmentation in OCTA images is still an open problem, and especially the thin and dense structure of the capillary plexus is an important challenge of this problem. In this work, we propose a novel image magnification network (IMN) for vessel segmentation in OCTA images. Contrary to the U-Net structure with a down-sampling encoder and up-sampling decoder, the proposed IMN adopts the design of up-sampling encod…
VAMPIRE: Uncovering Vessel Directional and Morphological Information from OCTA Images for Cardiovascular Disease Risk Factor Prediction
The Hong Kong University of Science and Technology, Hong Kong, China（香港科学与技术大学）；Department of Radiology, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China（广东省人民医院放射科（广东省医学科学院）南方医科大学）；Health Management Center, Foshan First People's Hospital（佛山第一人民医院健康管理中心）；Health Management Center, The Sixth Affiliated Hospital, School of Medicine, South China University of Technology（健康管理中心，华南理工大学医学院第六附属医院）
Simon Fraser University（西蒙弗雷泽大学）；Google Inc.（谷歌公司）；Tencent Technologies（腾讯科技）
Learned image compression has recently shown the potential to outperform the standard codecs. State-of-the-art rate-distortion (R-D) performance has been achieved by context-adaptive entropy coding approaches in which hyperprior and autoregressive models are jointly utilized to effectively capture the spatial dependencies in the latent representations. However, the latents are feature maps of the same spatial resolution in previous works, which contain some redundancies that affect the R-D performance. In this paper, we propose the first learned multi-frequency image compression and entropy co…
OMSN and FAROS: OCTA Microstructure Segmentation Network and Fully Annotated Retinal OCTA Segmentation Dataset
State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University（中山大学中山眼科中心眼科学国家重点实验室）；Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science（广东省眼科与视觉科学重点实验室）
The University of Western Australia（西澳大利亚大学）；University of Surrey（萨里大学）；Academy of Athens（雅典科学院）；Surrey and Sussex Healthcare NHS Trust（萨里和萨塞克斯医疗保健 NHS 信托）；The University of Surrey（萨里大学）
Optical coherence tomography angiography (OCTA) performs non-invasive visualization and characterization of microvasculature in research and clinical applications mainly in ophthalmology and dermatology. A wide variety of instruments, imaging protocols, processing methods and metrics have been used to describe the microvasculature, such that comparing different study outcomes is currently not feasible. With the goal of contributing to standardization of OCTA data analysis, we report a user-friendly, open-source toolbox, OCTAVA (OCTA Vascular Analyzer), to automate the pre-processing, segmentat…
Beijing Institute of Technology（北京理工大学）；Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences（中国科学院宁波材料技术与工程研究所）；Cixi Institute of Biomedical Engineering（慈溪生物医学工程研究所）；Ningbo University of Technology（宁波工程学院）
Retinal Optical Coherence Tomography Angiography (OCTA) with high-resolution is important for the quantification and analysis of retinal vasculature. However, the resolution of OCTA images is inversely proportional to the field of view at the same sampling frequency, which is not conducive to clinicians for analyzing larger vascular areas. In this paper, we propose a novel Sparse-based domain Adaptation Super-Resolution network (SASR) for the reconstruction of realistic 6x6 mm2/low-resolution (LR) OCTA images to high-resolution (HR) representations. To be more specific, we first perform a simp…
Southern University of Science and Technology（南方科技大学）；The University of Hong Kong（香港大学）；The University of British Columbia（不列颠哥伦比亚大学）；Jiaxing Research Institute, Southern University of Science and Technology（南方科技大学嘉兴研究院）
Medical image quality assessment (MIQA) is a vital prerequisite in various medical image analysis applications. Most existing MIQA algorithms are fully supervised that request a large amount of annotated data. However, annotating medical images is time-consuming and labor-intensive. In this paper, we propose an unsupervised anomaly-aware framework with test-time clustering for optical coherence tomography angiography (OCTA) image quality assessment in a setting wherein only a set of high-quality samples are accessible in the training phase. Specifically, a feature-embedding-based low-quality r…
Despite significant advances in artificial intelligence (AI) for computer vision, its application in medical imaging has been limited by the burden and limits of expert-generated labels. We used images from optical coherence tomography angiography (OCTA), a relatively new imaging modality that measures perfusion of the retinal vasculature, to train an AI algorithm to generate vasculature maps from standard structural optical coherence tomography (OCT) images of the same retinae, both exceeding the ability and bypassing the need for expert labeling. Deep learning was able to infer perfusion of …
Optical coherence tomography angiography (OCTA) is an important imaging modality in many bioengineering tasks. The image quality of OCTA, however, is often degraded by Bulk Motion Artifacts (BMA), which are due to micromotion of subjects and typically appear as bright stripes surrounded by blurred areas. State-of-the-art methods usually treat BMA removal as a learning-based image inpainting problem, but require numerous training samples with nontrivial annotation. In addition, these methods discard the rich structural and appearance information carried in the BMA stripe region. To address thes…
WPS-SAM: Towards Weakly-Supervised Part Segmentation with Foundation Models
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）
