现有的从OCT图像中分割主要视网膜层的方法通常假设视网膜已被预先展平，因此往往无法处理因眼病导致视网膜结构发生变化和/或因近视导致曲率变化的视网膜。为了在视网膜层分割中取消展平操作以提高此类方法的实用性，我们提出了用于OCT图像的新型数据增强方法。公式驱动数据增强（FDDA）根据给定的数学公式对OCT图像的每一列进行垂直位移，从而模拟多种视网膜结构。我们还提出了部分视网膜层复制（PRLC），该方法复制视网膜层的一部分，并将其粘贴到视网膜层之外的区域。通过使用OCT MS and Healthy Control数据集和Duke Cyst DME数据集进行实验，我们证明，即使是那些假设视网膜已展平的视网膜层分割方法，使用FDDA和PRLC后也能够在不进行展平的情况下检测视网膜层边界。
英文摘要：
Major retinal layer segmentation methods from OCT images assume that the retina is flattened in advance, and thus cannot always deal with retinas that have changes in retinal structure due to ophthalmopathy and/or curvature due to myopia. To eliminate the use of flattening in retinal layer segmentation for practicality of such methods, we propose novel data augmentation methods for OCT images. Formula-driven data augmentation (FDDA) emulates a variety of retinal structures by vertically shifting each column of the OCT images according to a given mathematical formula. We also propose partial retinal layer copying (PRLC) that copies a part of the retinal layers and pastes it into a region outside the retinal layers. Through experiments using the OCT MS and Healthy Control dataset and the Duke Cyst DME dataset, we demonstrate that the use of FDDA and PRLC makes it possible to detect the boundaries of retinal layers without flattening even retinal layer segmentation methods that assume flattening of the retina.
Convolutional neural networks have been widely applied to medical image segmentation and have achieved considerable performance. However, the performance may be significantly affected by the domain gap between training data (source domain) and testing data (target domain). To address this issue, we propose a data manipulation based domain generalization method, called Automated Augmentation for Domain Generalization (AADG). Our AADG framework can effectively sample data augmentation policies that generate novel domains and diversify the training set from an appropriate search space. Specifical…
Retinal Vessel Segmentation is important for the diagnosis of various diseases. The research on retinal vessel segmentation focuses mainly on the improvement of the segmentation model which is usually based on U-Net architecture. In our study, we use the U-Net architecture and we rely on heavy data augmentation in order to achieve better performance. The success of the data augmentation relies on successfully addressing the problem of input images. By analyzing input images and performing the augmentation accordingly we show that the performance of the U-Net model can be increased dramatically…
Medical image segmentation is an important task for computer aided diagnosis. Pixelwise manual annotations of large datasets require high expertise and is time consuming. Conventional data augmentations have limited benefit by not fully representing the underlying distribution of the training set, thus affecting model robustness when tested on images captured from different sources. Prior work leverages synthetic images for data augmentation ignoring the interleaved geometric relationship between different anatomical labels. We propose improvements over previous GAN-based medical image synthes…
Retinal vessel segmentation is a fundamental step in screening, diagnosis, and treatment of various cardiovascular and ophthalmic diseases. Robustness is one of the most critical requirements for practical utilization, since the test images may be captured using different fundus cameras, or be affected by various pathological changes. We investigate this problem from a data augmentation perspective, with the merits of no additional training data or inference time. In this paper, we propose two new data augmentation modules, namely, channel-wise random Gamma correction and channel-wise random v…
Budapest University of Technology and Economics（布达佩斯技术与经济大学）；Hospital of the Peoples Liberation Army Joint Logistics Support Force（中国人民解放军联勤保障部队医院）；Jiangxi Normal University（江西师范大学）；Shenyang Institute of Computing Technology, Chinese Academy of Science（中国科学院沈阳计算技术研究所）
Retinal vessel segmentation is a vital step for the diagnosis of many early eye-related diseases. In this work, we propose a new deep learning model, namely Channel Attention Residual U-Net (CAR-UNet), to accurately segment retinal vascular and non-vascular pixels. In this model, we introduced a novel Modified Efficient Channel Attention (MECA) to enhance the discriminative ability of the network by considering the interdependence between feature maps. On the one hand, we apply MECA to the "skip connections" in the traditional U-shaped networks, instead of simply copying the feature maps of th…
Budapest University of Technology and Economics（布达佩斯技术与经济大学）；Jiangxi Normal University（江西师范大学）；Eötvös Loránd University（厄特沃什·罗兰大学）；Shenyang Aerospace University（沈阳航空航天大学）
Retinal vessel segmentation plays an imaportant role in the field of retinal image analysis because changes in retinal vascular structure can aid in the diagnosis of diseases such as hypertension and diabetes. In recent research, numerous successful segmentation methods for fundus images have been proposed. But for other retinal imaging modalities, more research is needed to explore vascular extraction. In this work, we propose an efficient method to segment blood vessels in Scanning Laser Ophthalmoscopy (SLO) retinal images. Inspired by U-Net, "feature map reuse" and residual learning, we pro…
Generation of Structurally Realistic Retinal Fundus Images with Diffusion Models
Seoul National University College of Medicine（首尔大学医学院）；Seoul National University Bundang Hospital（首尔大学盆唐医院）；VUNO, Inc.（VUNO公司）；Kookmin University（国民大学）
Many eye diseases like Diabetic Macular Edema (DME), Age-related Macular Degeneration (AMD), and Glaucoma manifest in the retina, can cause irreversible blindness or severely impair the central version. The Optical Coherence Tomography (OCT), a 3D scan of the retina with high qualitative information about the retinal morphology, can be used to diagnose and monitor changes in the retinal anatomy. Many Deep Learning (DL) methods have shared the success of developing an automated tool to monitor pathological changes in the retina. However, the success of these methods depend mainly on large datas…
Budapest University of Technology and Economics（布达佩斯技术与经济大学）；Jiangxi Normal University（江西师范大学）
The precise segmentation of retinal blood vessels is of great significance for early diagnosis of eye-related diseases such as diabetes and hypertension. In this work, we propose a lightweight network named Spatial Attention U-Net (SA-UNet) that does not require thousands of annotated training samples and can be utilized in a data augmentation manner to use the available annotated samples more efficiently. SA-UNet introduces a spatial attention module which infers the attention map along the spatial dimension, and multiplies the attention map by the input feature map for adaptive feature refin…
Technical University of Munich（慕尼黑工业大学）；Imperial College London（帝国理工学院）；University of Zurich（苏黎世大学）
Optical coherence tomography angiography (OCTA) can non-invasively image the eye's circulatory system. In order to reliably characterize the retinal vasculature, there is a need to automatically extract quantitative metrics from these images. The calculation of such biomarkers requires a precise semantic segmentation of the blood vessels. However, deep-learning-based methods for segmentation mostly rely on supervised training with voxel-level annotations, which are costly to obtain. In this work, we present a pipeline to synthesize large amounts of realistic OCTA images with intrinsically matc…
COMSATS University Islamabad（伊斯兰堡 COMSATS 大学）；Deakin University（迪肯大学）；Victoria University（维多利亚大学）
Diabetic retinopathy refers to the pathology of the retina induced by diabetes and is one of the leading causes of preventable blindness in the world. Early detection of diabetic retinopathy is critical to avoid vision problem through continuous screening and treatment. In traditional clinical practice, the involved lesions are manually detected using photographs of the fundus. However, this task is cumbersome and time-consuming and requires intense effort due to the small size of lesion and low contrast of the images. Thus, computer-assisted diagnosis of diabetic retinopathy based on the dete…
Southern University of Science and Technology（南方科技大学）；The University of Hong Kong（香港大学）；Jiaxing Research Institute, Southern University of Science and Technology（南方科技大学嘉兴研究院）
Unsupervised domain adaptation has been proposed recently to tackle the so-called domain shift between training data and test data with different distributions. However, most of them only focus on single-target domain adaptation and cannot be applied to the scenario with multiple target domains. In this paper, we propose RVms, a novel unsupervised multi-target domain adaptation approach to segment retinal vessels (RVs) from multimodal and multicenter retinal images. RVms mainly consists of a style augmentation and transfer (SAT) module and a dual-teacher knowledge distillation (DTKD) module. S…
Indian Institute of Technology Kharagpur（印度理工学院卡哈拉格普尔分校）；National Institute of Technology Durgapur（杜尔加布尔国家理工学院）
Segmentation of macro and microvascular structures in fundoscopic retinal images plays a crucial role in the detection of multiple retinal and systemic diseases, yet it is a difficult problem to solve. Most neural network approaches face several issues such as lack of enough parameters, overfitting and/or incompatibility between internal feature-spaces. We propose Attention W-Net, a new U-Net based architecture for retinal vessel segmentation to address these problems. In this architecture, we have two main contributions: Attention Block and regularisation measures. Our Attention Block uses at…
Improvement Strategies for Few-Shot Learning in OCT Image Classification of Rare Retinal Diseases
Department of Electrical Engineering, Yuan Ze University（电气工程系，元智大学）；Department of Electrical Engineering, National Taiwan Normal University（电气工程系，国立台湾师范大学）；Department of Ophthalmology, Far Eastern Memorial Hospital（眼科部，东部医疗院）
Technical University of Munich（慕尼黑工业大学）；Institute of AI for Health, Helmholtz Munich（亥姆霍兹慕尼黑中心健康人工智能研究所）；Munich School for Data Science（慕尼黑数据科学学院）；Institute of Computational Biology, Helmholtz Munich（亥姆霍兹慕尼黑中心计算生物学研究所）；Ludwig-Maximilians-University（路德维希-马克西米利安大学）
Optical coherence tomography (OCT) imaging from different camera devices causes challenging domain shifts and can cause a severe drop in accuracy for machine learning models. In this work, we introduce a minimal noise adaptation method based on a singular value decomposition (SVDNA) to overcome the domain gap between target domains from three different device manufacturers in retinal OCT imaging. Our method utilizes the difference in noise structure to successfully bridge the domain gap between different OCT devices and transfer the style from unlabeled target domain images to source images fo…
Beihang University（北京航空航天大学）；Peng Cheng Laboratory（鹏城实验室）；RIKEN AIP（理化学研究所人工智能研究中心）；University of Tokyo（东京大学）；Ningbo Institute of Industrial Technology, CAS（中国科学院宁波工业技术研究院）
Though deep learning has shown successful performance in classifying the label and severity stage of certain diseases, most of them give few explanations on how to make predictions. Inspired by Koch's Postulates, the foundation in evidence-based medicine (EBM) to identify the pathogen, we propose to exploit the interpretability of deep learning application in medical diagnosis. By determining and isolating the neuron activation patterns on which diabetic retinopathy (DR) detector relies to make decisions, we demonstrate the direct relation between the isolated neuron activation and lesions for…
Controllable retinal image synthesis using conditional StyleGAN and latent space manipulation for improved diagnosis and grading of diabetic retinopathy
Amirkabir University of Technology（阿米尔卡比尔理工大学）；Tehran Medical Sciences, Islamic Azad University（伊斯兰阿扎德大学德黑兰医学科学分校）
CMEMS-UMinho Research Unit（米尼奥大学CMEMS研究中心）；University of Minho（米尼奥大学）
The retinal vascular condition is a reliable biomarker of several ophthalmologic and cardiovascular diseases, so automatic vessel segmentation may be crucial to diagnose and monitor them. In this paper, we propose a novel method that combines the multiscale analysis provided by the Stationary Wavelet Transform with a multiscale Fully Convolutional Neural Network to cope with the varying width and direction of the vessel structure in the retina. Our proposal uses rotation operations as the basis of a joint strategy for both data augmentation and prediction, which allows us to explore the inform…
The optic disc is a crucial diagnostic feature in the eye since changes to its physiognomy is correlated with the severity of various ocular and cardiovascular diseases. While identifying the bulk of the optic disc in a color fundus image is straightforward, accurately segmenting its boundary at the pixel level is very challenging. In this work, we propose disc-centered patch augmentation (DCPA) -- a simple, yet novel training scheme for deep neural networks -- to address this problem. DCPA achieves state-of-the-art results on full-size images even when using small neural networks, specificall…
Vidyasirimedhi Institute of Science & Technology（维迪亚西里梅迪科技学院）；Kamnoetvidya Science Academy（卡姆诺维迪亚科学学院）；Ningbo Institute of Industrial Technology, Chinese Academy of Sciences（中国科学院宁波工业技术研究院）；Cixi Institute of Biomedical Engineering（慈溪生物医学工程研究所）；Kasetsart University（泰国农业大学）；Nanyang Technological University（南洋理工大学）
While there have been increased researches using deep learning techniques for the extraction of vascular structure from the 2D en face OCTA, for such approach, it is known that the data annotation process on the curvilinear structure like the retinal vasculature is very costly and time consuming, albeit few tried to address the annotation problem. In this work, we propose the application of the scribble-base weakly-supervised learning method to automate the pixel-level annotation. The proposed method, called OCTAve, combines the weakly-supervised learning using scribble-annotated ground truth …
Domain-specific augmentations with resolution agnostic self-attention mechanism improves choroid segmentation in optical coherence tomography images
School of Mathematics, University of Edinburgh（爱丁堡大学数学学院）；Institute for Regeneration and Repair, University of Edinburgh（爱丁堡大学再生与修复研究所）；School of Informatics, University of Edinburgh（爱丁堡大学信息学院）；Centre for Medical Informatics, University of Edinburgh（爱丁堡大学医学信息学中心）；Clinical Research Facility and Imaging, University of Edinburgh（爱丁堡大学临床研究与影像中心）；Department of Vision Sciences, Glasgow Caledonian University（格拉斯哥卡利多尼安大学视觉科学系）；British Heart Foundation Centre for Cardiovascular Science, University of Edinburgh（爱丁堡大学英国心脏基金会心血管科学中心）；Centre for Clinical Brain Sciences, University of Edinburgh（爱丁堡大学临床脑科学中心）
