Optical coherence tomography (OCT) is a micrometer-scale, volumetric imaging modality that has become a clinical standard in ophthalmology. OCT instruments image by raster-scanning a focused light spot across the retina, acquiring sequential cross-sectional images to generate volumetric data. Patient eye motion during the acquisition poses unique challenges: Non-rigid, discontinuous distortions can occur, leading to gaps in data and distorted topographic measurements. We present a new distortion model and a corresponding fully-automatic, reference-free optimization strategy for computational motion correction in orthogonally raster-scanned, retinal OCT volumes. Using a novel, domain-specific spatiotemporal parametrization of forward-warping displacements, eye motion can be corrected continuously for the first time. Parameter estimation with temporal regularization improves robustness and accuracy over previous spatial approaches. We correct each A-scan individually in 3D in a single mapping, including repeated acquisitions used in OCT angiography protocols. Specialized 3D forward image warping reduces median runtime to < 9 s, fast enough for clinical use. We present a quantitative evaluation on 18 subjects with ocular pathology and demonstrate accurate correction during microsaccades. Transverse correction is limited only by ocular tremor, whereas submicron repeatability is achieved axially (0.51 um median of medians), representing a dramatic improvement over previous work. This allows assessing longitudinal changes in focal retinal pathologies as a marker of disease progression or treatment response, and promises to enable multiple new capabilities such as supersampled/super-resolution volume reconstruction and analysis of pathological eye motion occuring in neurological diseases.
Fudan University（复旦大学）；Shanghai General Hospital, School of Medicine, Shanghai Jiao Tong University（上海交通大学医学院附属上海市第一人民医院）
The ultra-wide optical coherence tomography angiography (OCTA) has become an important imaging modality in diabetic retinopathy (DR) diagnosis. However, there are few researches focusing on automatic DR analysis using ultra-wide OCTA. In this paper, we present novel and practical deep-learning solutions based on ultra-wide OCTA for the Diabetic Retinopathy Analysis Challenge (DRAC). In the segmentation of DR lesions task, we utilize UNet and UNet++ to segment three lesions with strong data augmentation and model ensemble. In the image quality assessment task, we create an ensemble of Inception…
Spatiotemporal optical coherence (STOC) imaging is a new technique for suppressing coherent crosstalk noise in Fourier-domain full-field optical coherence tomography (FD-FF-OCT). In STOC imaging, the timevarying inhomogeneous phase masks modulate the incident light to alter the interferometric signal. Resulting interference images are then processed as in standard FD-FF-OCT and averaged incoherently or coherently to produce crosstalk-free volumetric OCT images of the sample. Here, we show that coherent averaging is suitable when phase modulation is performed for both interferometer arms simult…
University of Isfahan（伊斯法罕大学）；Isfahan University of Medical Sciences（伊斯法罕医科大学）
Diabetic Retinopathy (DR) caused by diabetes occurs as a result of changes in the retinal vessels and causes visual impairment. Microaneurysms (MAs) are the early clinical signs of DR, whose timely diagnosis can help detecting DR in the early stages of its development. It has been observed that MAs are more common in the inner retinal layers compared to the outer retinal layers in eyes suffering from DR. Optical Coherence Tomography (OCT) is a noninvasive imaging technique that provides a cross-sectional view of the retina and it has been used in recent years to diagnose many eye diseases. As …
Shahid Beheshti University（沙希德·贝赫什提大学）；Shahid Beheshti University of Medical Sciences（沙希德·贝赫什提医科大学）
Intra retinal fluids or Cysts are one of the important symptoms of macular pathologies that are efficiently visualized in OCT images. Automatic segmentation of these abnormalities has been widely investigated in medical image processing studies. In this paper, we propose a new U-Net-based approach for Intra retinal cyst segmentation across different vendors that improves some of the challenges faced by previous deep-based techniques. The proposed method has two main steps: 1- prior information embedding and input data adjustment, and 2- IRC segmentation model. In the first step, we inject the …
Philips Research North America（飞利浦北美研究院）；Johns Hopkins University（约翰斯·霍普金斯大学）
Accurate, real-time segmentation of vessel structures in ultrasound image sequences can aid in the measurement of lumen diameters and assessment of vascular diseases. This, however, remains a challenging task, particularly for extremely small vessels that are difficult to visualize. We propose to leverage the rich spatiotemporal context available in ultrasound to improve segmentation of small-scale lower-extremity arterial vasculature. We describe efficient deep learning methods that incorporate temporal, spatial, and feature-aware contextual embeddings at multiple resolution scales while join…
OCTolyzer: Fully automatic toolkit for segmentation and feature extracting in optical coherence tomography and scanning laser ophthalmoscopy data
University of Edinburgh（爱丁堡大学）；Institute for Regeneration and Repair（再生与修复研究所）；Glasgow Caledonian University（格拉斯哥卡利多尼亚大学）；British Heart Foundation Centre for Cardiovascular Science（英国心脏基金会心血管科学中心）；Clinical Research Facility and Imaging（临床研究设施与影像中心）；Centre for Clinical Brain Sciences（临床脑科学中心）；School of Informatics（信息学院）；Institute for Adaptive and Neural Computation（自适应与神经计算研究所）；School of Mathematics（数学学院）
Taking into account that glaucoma is the leading cause of blindness worldwide, we propose in this paper three different learning methodologies for glaucoma detection in order to elucidate that traditional machine-learning techniques could outperform deep-learning algorithms, especially when the image data set is small. The experiments were performed on a private database composed of 194 glaucomatous and 198 normal B-scans diagnosed by expert ophthalmologists. As a novelty, we only considered raw circumpapillary OCT images to build the predictive models, without using other expensive tests such…
The choroid is vascular tissue located underneath the retina and supplies oxygen to the outer retina; any damage to this tissue can be a precursor to retinal disease. Choroid is almost invisible in Enhanced Depth Imaging Optical Coherence Tomography (EDI-OCT) images and it is hard for an ophthalmologist to detect this layer manually. This paper presents an automatic method of choroidal segmentation from EDI-OCT images in neutrosophic space. In neutrosophic approach for image processing, extracting any information from an image and applying any process on it, is modeled by three sets including …
Automatic analysis of spatio-temporal microscopy images is inevitable for state-of-the-art research in the life sciences. Recent developments in deep learning provide powerful tools for automatic analyses of such image data, but heavily depend on the amount and quality of provided training data to perform well. To this end, we developed a new method for realistic generation of synthetic 2D+t microscopy image data of fluorescently labeled cellular nuclei. The method combines spatiotemporal statistical shape models of different cell cycle stages with a conditional GAN to generate time series of …
The choroid provides oxygen and nourishment to the outer retina thus is related to the pathology of various ocular diseases. Optical coherence tomography (OCT) is advantageous in visualizing and quantifying the choroid in vivo. (1) The lower boundary of the choroid (choroid-sclera interface) in OCT is fuzzy, which makes the automatic segmentation difficult and inaccurate. (2) The visualization of the choroid is hindered by the vessel shadows from the superficial layers of the inner retina. In this paper, we propose to incorporate medical and imaging prior knowledge with deep learning to addres…
Khulna University of Engineering and Technology（库尔纳工程技术大学）
In medical science, the use of computer science in disease detection and diagnosis is gaining popularity. Previously, the detection of disease used to take a significant amount of time and was less reliable. Machine learning (ML) techniques employed in recent biomedical researches are making revolutionary changes by gaining higher accuracy with more concise timing. At present, it is even possible to automatically detect diseases from the scanned images with the help of ML. In this research, we have taken such an attempt to detect retinal diseases from optical coherence tomography (OCT) X-ray i…
Simon Fraser University（西蒙菲莎大学）；University of British Columbia（不列颠哥伦比亚大学）；University of Western Australia（西澳大学）；Lions Eye Institute（狮子眼科研究所）；Vitreous Retina Macula Consultants of New York（纽约玻璃体视网膜黄斑 Consultants）；Manhattan Eye, Ear and Throat Hospital（曼哈顿眼耳鼻喉医院）；University of Zagreb（萨格勒布大学）
Automatic quantification of perifoveal vessel densities in optical coherence tomography angiography (OCT-A) images face challenges such as variable intra- and inter-image signal to noise ratios, projection artefacts from outer vasculature layers, and motion artefacts. This study demonstrates the utility of deep neural networks for automatic quantification of foveal avascular zone (FAZ) parameters and perifoveal vessel density of OCT-A images in healthy and diabetic eyes. OCT-A images of the foveal region were acquired using three OCT-A systems: a 1060nm Swept Source (SS)-OCT prototype, RTVue X…
Technical University of Munich（慕尼黑工业大学）；Imperial College London（帝国理工学院）；University of Zurich（苏黎世大学）
Optical coherence tomography angiography (OCTA) can non-invasively image the eye's circulatory system. In order to reliably characterize the retinal vasculature, there is a need to automatically extract quantitative metrics from these images. The calculation of such biomarkers requires a precise semantic segmentation of the blood vessels. However, deep-learning-based methods for segmentation mostly rely on supervised training with voxel-level annotations, which are costly to obtain. In this work, we present a pipeline to synthesize large amounts of realistic OCTA images with intrinsically matc…
Columbia University（哥伦比亚大学）；Stevens Institute of Technology（史蒂文斯理工学院）；Imperial College London（帝国理工学院）；Institut Polytechnique de Paris（巴黎理工学院）
Automatically identifying the structural substrates underlying cardiac abnormalities can potentially provide real-time guidance for interventional procedures. With the knowledge of cardiac tissue substrates, the treatment of complex arrhythmias such as atrial fibrillation and ventricular tachycardia can be further optimized by detecting arrhythmia substrates to target for treatment (i.e., adipose) and identifying critical structures to avoid. Optical coherence tomography (OCT) is a real-time imaging modality that aids in addressing this need. Existing approaches for cardiac image analysis main…
University of Coimbra（科英布拉大学）；Erasmus MC（伊拉斯姆斯大学医学中心）；KU Leuven（鲁汶大学）；University of Porto（波尔图大学）；Centro Hospitalar e Universitário São João（圣若昂大学医院中心）；University Hospitals UZ Leuven（鲁汶大学医院）
The optic nerve head represents the intraocular section of the optic nerve (ONH), which is prone to damage by intraocular pressure. The advent of optical coherence tomography (OCT) has enabled the evaluation of novel optic nerve head parameters, namely the depth and curvature of the lamina cribrosa (LC). Together with the Bruch's membrane opening minimum-rim-width, these seem to be promising optic nerve head parameters for diagnosis and monitoring of retinal diseases such as glaucoma. Nonetheless, these optical coherence tomography derived biomarkers are mostly extracted through manual segment…
Denoising, segmentation and volumetric rendering of optical coherence tomography angiography (OCTA) image using deep learning techniques: a review
Department of Mechanical and Electronic Engineering, Kunming University of Science and Technology（昆明理工大学机械电子工程系）；Eye Clinics, Yunnan First People's Hospital（云南第一人民医院眼科）
In this study, we demonstrate a novel self-navigated motion correction method that suppresses eye motion and blinking artifacts on wide-field optical coherence tomographic angiography (OCTA) without requiring any hardware modification. Highly efficient GPU-based, real-time OCTA image acquisition and processing software was developed to detect eye motion artifacts. The algorithm includes an instantaneous motion index that evaluates the strength of motion artifact on en face OCTA images. Areas with suprathreshold motion and eye blinking artifacts are automatically rescanned in real-time. Both he…
Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences（中国科学院宁波材料技术与工程研究所慈溪生物医学工程研究所）；University of Liverpool（利物浦大学）；University of Southern California（南加州大学）；Southern University of Science and Technology（南方科技大学）；University of Chinese Academy of Sciences（中国科学院大学）
Optical Coherence Tomography Angiography (OCTA) has been increasingly used in the management of eye and systemic diseases in recent years. Manual or automatic analysis of blood vessel in 2D OCTA images (en face angiograms) is commonly used in clinical practice, however it may lose rich 3D spatial distribution information of blood vessels or capillaries that are useful for clinical decision-making. In this paper, we introduce a novel 3D vessel reconstruction framework based on the estimation of vessel depth maps from OCTA images. First, we design a network with structural constraints to predict…
University of Electronic Science and Technology of China（电子科技大学）；SenseTime Research（商汤科技研究院）；Huashan Hospital, Fudan University（复旦大学附属华山医院）；Fudan University（复旦大学）；Jing’an District Centre Hospital of Shanghai（上海市静安区中心医院）
Ischemic stroke lesion segmentation from Computed Tomography Perfusion (CTP) images is important for accurate diagnosis of stroke in acute care units. However, it is challenged by low image contrast and resolution of the perfusion parameter maps, in addition to the complex appearance of the lesion. To deal with this problem, we propose a novel framework based on synthesized pseudo Diffusion-Weighted Imaging (DWI) from perfusion parameter maps to obtain better image quality for more accurate segmentation. Our framework consists of three components based on Convolutional Neural Networks (CNNs) a…
Retinal OCT Synthesis with Denoising Diffusion Probabilistic Models for Layer Segmentation
Institute of Imaging and Computer Vision, RWTH Aachen University（成像与计算机视觉研究所，亚琛RWTH大学）；Bio-manufacturing Engineering Laboratory of Tsinghua SIGS, Tsinghua University（清华大学SIGS生物制造工程实验室）；Shenzhen Eye Hospital（深圳眼科医院）；Department of Ophthalmology, RWTH Aachen University（眼科部，亚琛RWTH大学）
Given the capacity of Optical Coherence Tomography (OCT) imaging to display symptoms of a wide variety of eye diseases and neurological disorders, the need for OCT image segmentation and the corresponding data interpretation is latterly felt more than ever before. In this paper, we wish to address this need by designing a semi-automatic software program for applying reliable segmentation of 8 different macular layers as well as outlining retinal pathologies such as diabetic macular edema. The software accommodates a novel graph-based semi-automatic method, called ''Livelayer'' which is designe…
Institute of Imaging and Computer Vision, RWTH Aachen University（亚琛工业大学成像与计算机视觉研究所）；Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院自动化与应用信息学研究所）
Automatic analyses and comparisons of different stages of embryonic development largely depend on a highly accurate spatiotemporal alignment of the investigated data sets. In this contribution, we assess multiple approaches for automatic staging of developing embryos that were imaged with time-resolved 3D light-sheet microscopy. The methods comprise image-based convolutional neural networks as well as an approach based on the PointNet architecture that directly operates on 3D point clouds of detected cell nuclei centroids. The experiments with four wild-type zebrafish embryos render both appro…
Segmentation of Retinal Low-Cost Optical Coherence Tomography Images using Deep Learning
Institute of Medical Informatics, University of Lübeck（吕贝克大学医学信息学研究所）；University of Lübeck（吕贝克大学）；Graduate School for Computing in Medicine and Life Sciences, University of Lübeck（医学与生命科学计算研究生学院，吕贝克大学）；Medical Laser Center Lübeck（吕贝克医疗激光中心）；Department of Ophthalmology, University of Kiel（基尔大学眼科部门）；Institute of Biomedical Optics, University of Lübeck（吕贝克大学生物医学光学研究所）
Medical University of Vienna（维也纳医科大学）；Carl Zeiss Meditec, Inc.（卡尔蔡司医疗技术公司）
The automatic detection and localization of anatomical features in retinal imaging data are relevant for many aspects. In this work, we follow a data-centric approach to optimize classifier training for optic nerve head detection and localization in optical coherence tomography en face images of the retina. We examine the effect of domain knowledge driven spatial complexity reduction on the resulting optic nerve head segmentation and localization performance. We present a machine learning approach for segmenting optic nerve head in 2D en face projections of 3D widefield swept source optical co…
Attenuation artifact detection and severity classification in intracoronary OCT using mixed image representations
Amsterdam UMC（阿姆斯特丹大学医学中心）；University of Amsterdam（阿姆斯特丹大学）；Amsterdam Cardiovascular Sciences（阿姆斯特丹心血管科学中心）；Radboud University Medical Center（拉德堡德大学医学中心）
This paper develops an automatic freeway bottleneck identification and visualization algorithm using a combination of image processing techniques and traffic flow theory. Unlike previous studies that are based solely on loop detector data, the proposed method can use traffic measurements from various sensing technologies. Four steps are included in the proposed algorithm. First, the raw spatiotemporal speed data are transformed into binary matrices using image binarization techniques. Second, two post-processer filters are developed to clean the binary matrices by filtering scattered noise cel…
Enhancing Diagnostic Reliability of Foundation Model with Uncertainty Estimation in OCT Images
Joint Shantou International Eye Center, Shantou University and the Chinese University of Hong Kong（汕头大学香港中文大学联合汕头国际眼科中心）；College of Computer Science, Sichuan University（四川大学计算机学院）；First Affiliated Hospital of Anhui Medical University（安徽医科大学第一附属医院）；School of Biomedical Engineering, Anhui Medical University（安徽医科大学生物医学工程学院）；School of Electronics and Information Engineering, Soochow University（苏州大学电子信息工程学院）；State Key Laboratory of Radiation Medicine and Protection, Soochow University（苏州大学放射医学与防护国家重点实验室）；Beth Israel Deaconess Medical Center, Harvard Medical School（哈佛医学院贝斯以色列女执事医疗中心）；Institute of High Performance Computing (IHPC)（高性能计算研究所）
Ophthalmic Engineering and Innovation Laboratory, Department of Biomedical Engineering, Faculty of Engineering, National University of Singapore（新加坡国立大学工程学院生物医学工程系眼科工程与创新实验室）；Singapore Eye Research Institute, Singapore National Eye Centre（新加坡国立眼科中心新加坡眼科研究所）；Rajan Eye Care Hospital（拉詹眼科护理医院）
Since the introduction of optical coherence tomography (OCT), it has been possible to study the complex 3D morphological changes of the optic nerve head (ONH) tissues that occur along with the progression of glaucoma. Although several deep learning (DL) techniques have been recently proposed for the automated extraction (segmentation) and quantification of these morphological changes, the device specific nature and the difficulty in preparing manual segmentations (training data) limit their clinical adoption. With several new manufacturers and next-generation OCT devices entering the market, t…
Modern optical coherence tomography (OCT) devices provide volumetric images with micrometer-scale spatial resolution and a temporal resolution beyond video rate. In this work, we analyze an OCT-based prototypical tracking system which processes 831 volumes per second, estimates translational motion, and automatically adjusts the field-of-view, which has a size of few millimeters, to follow a sample even along larger distances. The adjustment is realized by two galvo mirrors and a motorized reference arm, such that no mechanical movement of the scanning setup is necessary. Without requiring a m…
