Optical coherence tomography (OCT) is a volumetric imaging modality that empowers clinicians and scientists to noninvasively visualize the cross-sections of biological samples. As the latest generation of its kind, Fourier-domain OCT (FD-OCT) offers a micrometer-scale axial resolution by taking advantage of coherence gating. Based on the current theory, it is believed the only way to obtain a higher-axial-resolution OCT image is to physically extend the system's spectral bandwidth given a certain central wavelength. Here, we showed the belief is wrong. We proposed a novel reconstruction framework, which integrates prior knowledge and exploits the \emph{shift-variance}, to retrospectively super-resolve OCT images without altering the system configurations. Both numerical and experimental results confirmed the processed image manifested an axial resolution beyond the previous theoretical prediction. We believe this result not only opens new horizons for future research directions in OCT reconstruction but also promises an immediate upgrade to tens of thousands of legacy OCT units currently deployed.
We demonstrate swept-source optical coherence tomography in real-time by high throughput digital Fresnel hologram rendering from optically-acquired interferograms with a high-speed camera. The interferogram stream is spatially rescaled with respect to wavelength to compensate for field-of-view dilation inherent to discrete Fresnel transformation. Holograms are calculated from an input stream of 16-bit, 1024-by-1024-pixel interferograms recorded at up to 512 frames per second with a digital camera. All calculations are performed by a NVIDIA TITAN Xp graphics card on single-precision floating-po…
We have developed a multimodal photoacoustic remote sensing (PARS) microscope combined with swept source optical coherence tomography for in vivo, non-contact retinal imaging. Building on the proven strength of multiwavelength PARS imaging, the system is applied for estimating retinal oxygen saturation in the rat retina. The capability of the technology is demonstrated by imaging both microanatomy and the microvasculature of the retina in vivo. To our knowledge this is the first time a non-contact photoacoustic imaging technique is employed for in vivo oxygen saturation measurement in the reti…
High-resolution optical imaging methods, such as confocal microscopy and full-field optical coherence tomography, capture flat optical sections of the sample. If the sample is curved, the optical field sections through several sample layers and the view of each layer is reduced. Here we present curved-field optical coherence tomography, capable of capturing optical sections of arbitrary curvature. We test the device on a challenging task of imaging the human cornea in vivo and achieve 10x larger viewing area comparing to the clinical state-of-the-art. This enables more precise cell and nerve c…
Optical coherence tomography angiography (OCTA) requires high transverse sampling density for visualizing retinal and choroidal capillaries. Low transverse sampling causes resolution degradation, such as the angiograms in wide-field OCTA. In this paper, we propose to address this problem using deep learning. We conducted extensive experiments on converting the centrally cropped 3 x 3 mm2 field of view (FOV) of the 8 x 8 mm2 foveal OCTA images (a sampling density of 22.9 $μ$m) to the native 3 x 3 mm2 en face OCTA images (a sampling density of 12.2 $μ$m). We employed a cycle-consistent adversari…
This dissertation relates to the transition of the state of the art of swept source optical coherence tomography (SS-OCT) systems to a new realm in which the image acquisition speed is improved by an order of magnitude. With the aid of a better quality imaging technology, the speed-up factor will considerably shorten the eye-exam clinical visits which in turn improves the patient and doctor interaction experience. These improvements will directly lower associated medical costs for eye-clinics and patients worldwide. There are several other embodiments closely related to Optical Coherence Tomog…
Optical coherence tomography offers astounding opportunities to image the complex structure of living tissue, but lacks functional information. We present dynamic full-field optical coherence tomography to image living human induced pluripotent stem cell-derived retinal organoids non-invasively. Colored images with an endogenous contrast linked to organelle motility are generated, with sub-micrometer spatial resolution and millisecond temporal resolution, opening an avenue to identify specific cell types in living tissue via their function.
Optical coherence tomography (OCT) has seen widespread success as an in vivo clinical diagnostic 3D imaging modality, impacting areas including ophthalmology, cardiology, and gastroenterology. Despite its many advantages, such as high sensitivity, speed, and depth penetration, OCT suffers from several shortcomings that ultimately limit its utility as a 3D microscopy tool, such as its pervasive coherent speckle noise and poor lateral resolution required to maintain millimeter-scale imaging depths. Here, we present 3D optical coherence refraction tomography (OCRT), a computational extension of O…
Intrinsic optical signal (IOS) imaging of the retina, also termed as optoretinography (ORG), promises a noninvasive method for objective assessment of retinal function. By providing unparalleled capability to differentiate individual layers of the retina, functional optical coherence tomography (OCT) has been actively investigated for intrinsic signal ORG measurements. However, clinical deployment of functional OCT for quantitative ORG is still challenging due to the lack of a standardized imaging protocol and the complication of IOS sources and mechanisms. This article aims to summarize recen…
Technion Israel Institute of Technology（以色列理工学院）；Rambam Health Care Campus（兰巴姆医疗中心）；University of Adelaide（阿德莱德大学）；Royal Adelaide Hospital（阿德莱德皇家医院）；South Australian Institute of Ophthalmology（南澳大利亚眼科研究所）；Clinical Research Institute at Rambam（兰巴姆临床研究所）
To explore the clinical validity of elastic deformation of optical coherence tomography (OCT) images for data augmentation in the development of deep-learning model for detection of diabetic macular edema (DME).
In this work we propose a ResNet-based universal method for speckle reduction in optical coherence tomography (OCT) images. The proposed model contains 3 main modules: Convolution-BN-ReLU, Branch and Residual module. Unlike traditional algorithms, the model can learn from training data instead of selecting parameters manually such as noise level. Application of this proposed method to the OCT images shows a more than 22 dB signal-to-noise ratio improvement in speckle noise reduction with minimal structure blurring. The proposed method provides strong generalization ability and can process nois…
We present a cascade deep neural network to segment retinal vessels in volumetric optical coherence tomography (OCT). Two types of knowledge are infused into the network for confining the searching regions. (1) Histology. The retinal vessels locate between the inner limiting membrane and the inner nuclear layer of human retina. (2) Imaging. The red blood cells inside the vessels scatter the OCT probe light forward and form projection shadows on the retinal pigment epithelium (RPE) layer, which is avascular thus perfect for localizing the retinal vessel in transverse plane. Qualitative and quan…
Modern optical coherence tomography (OCT) devices provide volumetric images with micrometer-scale spatial resolution and a temporal resolution beyond video rate. In this work, we analyze an OCT-based prototypical tracking system which processes 831 volumes per second, estimates translational motion, and automatically adjusts the field-of-view, which has a size of few millimeters, to follow a sample even along larger distances. The adjustment is realized by two galvo mirrors and a motorized reference arm, such that no mechanical movement of the scanning setup is necessary. Without requiring a m…
Optical Coherence Tomography Angiography-OCTA dataset for the study of Diabetic Retinopathy
Symbiosis Institute of Technology, Symbiosis International (Deemed University)（共生国际（ deemed 大学）共生技术学院）；University of Technology Sydney（悉尼科技大学）；Natasha Eye Care（娜塔莎眼科护理中心）
This study is to demonstrate deep learning for automated artery-vein (AV) classification in optical coherence tomography angiography (OCTA). The AV-Net, a fully convolutional network (FCN) based on modified U-shaped CNN architecture, incorporates enface OCT and OCTA to differentiate arteries and veins. For the multi-modal training process, the enface OCT works as a near infrared fundus image to provide vessel intensity profiles, and the OCTA contains blood flow strength and vessel geometry features. A transfer learning process is also integrated to compensate for the limitation of available da…
Accurate choroid segmentation in optical coherence tomography (OCT) image is vital because the choroid thickness is a major quantitative biomarker of many ocular diseases. Deep learning has shown its superiority in the segmentation of the choroid region but subjects to the performance degeneration caused by the domain discrepancies (e.g., noise level and distribution) among datasets obtained from the OCT devices of different manufacturers. In this paper, we present an unsupervised perceptual-assisted adversarial adaptation (PAAA) framework for efficiently segmenting the choroid area by narrowi…
Spectral domain optical coherence tomography (OCT) offers high resolution multidimensional imaging, but generally suffers from defocussing, intensity falloff and shot noise, causing artifacts and image degradation along the imaging depth. In this work, we develop an iterative statistical reconstruction technique, based upon the interferometric synthetic aperture microscopy (ISAM) model with additive noise, to actively compensate for these effects. For the ISAM re-sampling, we use a non uniform FFT with Kaiser-Bessel interpolation, offering efficiency and high accuracy. We then employ an accele…
We present a pseudo-real-time retinal layer segmentation for high-resolution Sensorless Adaptive Optics-Optical Coherence Tomography (SAO-OCT). Our pseudo-real-time segmentation method is based on Dijkstra's algorithm that uses the intensity of pixels and the vertical gradient of the image to find the minimum cost in a geometric graph formulation within a limited search region. It segments six retinal layer boundaries in an iterative process according to their order of prominence. The segmentation time is strongly correlated to the number of retinal layers to be segmented. Our program permits …
We consider the use of optical coherence tomography (OCT) imaging to predict the quality of meat. We find that intramuscular fat (IMF) absorbs infrared light about nine times stronger than muscle, which enables us to estimate fat content in intact meat samples. The method is made very efficient by extracting relevant information from the three-dimensional high-resolution images generated by OCT using principal component analysis (PCA). The principal components are then used as regressors into a support vector regression (SVR) prediction model. The SVR model is found to predict IMF content stab…
Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；Massachusetts Institute of Technology（麻省理工学院）；Tufts School of Medicine（塔夫茨医学院）
Optical coherence tomography angiography (OCTA) is a novel and clinically promising imaging modality to image retinal and sub-retinal vasculature. Based on repeated optical coherence tomography (OCT) scans, intensity changes are observed over time and used to compute OCTA image data. OCTA data are prone to noise and artifacts caused by variations in flow speed and patient movement. We propose a novel iterative maximum a posteriori signal recovery algorithm in order to generate OCTA volumes with reduced noise and increased image quality. This algorithm is based on previous work on probabilistic…
Shanghai Jiao Tong University（上海交通大学）；EPFL（洛桑联邦理工学院）；Shanghai General Hospital（上海市第一人民医院）
Projection map (PM) from optical coherence tomography (OCT) B-scan is an important tool to diagnose retinal diseases, which typically requires retinal layer segmentation. In this study, we present a novel end-to-end framework to predict PMs from B-scans. Instead of segmenting retinal layers explicitly, we represent them implicitly as predicted coordinates. By pixel interpolation on uniformly sampled coordinates between retinal layers, the corresponding PMs could be easily obtained with pooling. Notably, all the operators are differentiable; therefore, this Differentiable Projection Module (DPM…
Georgia Institute of Technology（佐治亚理工学院）；Retina Consultants Texas（得克萨斯视网膜咨询中心）；Retina Consultants of America（美国视网膜咨询中心）
In this paper, we propose a framework that incorporates experts diagnostics and insights into the analysis of Optical Coherence Tomography (OCT) using multi-modal learning. To demonstrate the effectiveness of this approach, we create a medical diagnostic attribute dataset to improve disease classification using OCT. Although there have been successful attempts to deploy machine learning for disease classification in OCT, such methodologies lack the experts insights. We argue that injecting ophthalmological assessments as another supervision in a learning framework is of great importance for th…
National Taiwan University（台湾大学）；Chang Gung Memorial Hospital（长庚纪念医院）；Chang Gung University（长庚大学）
Automated vascular segmentation on optical coherence tomography angiography (OCTA) is important for the quantitative analyses of retinal microvasculature in neuroretinal and systemic diseases. Despite recent improvements, artifacts continue to pose challenges in segmentation. Our study focused on removing the speckle noise artifact from OCTA images when performing segmentation. Speckle noise is common in OCTA and is particularly prominent over large non-perfusion areas. It may interfere with the proper assessment of retinal vasculature. In this study, we proposed a novel Supervision Vessel Seg…
Wellman Center for Photomedicine, Massachusetts General Hospital（马萨诸塞州总医院韦尔曼光医学中心）；Harvard Medical School（哈佛医学院）；Computer Science and Artificial Intelligence Laboratory (CSAIL), Massachusetts Institute of Technology（麻省理工学院计算机科学与人工智能实验室）；Erasmus Medical Center（伊拉斯谟医学中心）
Intravascular ultrasound and optical coherence tomography are widely available for characterizing coronary stenoses and provide critical vessel parameters to optimize percutaneous intervention. Intravascular polarization-sensitive optical coherence tomography (PS-OCT) simultaneously provides high-resolution cross-sectional images of vascular structures while also revealing preponderant tissue components such as collagen and smooth muscle and thereby enhances plaque characterization. Automated interpretation of these features promises to facilitate the objective clinical investigation of the na…
Simon Fraser University（西蒙弗雷泽大学）；Tencent YouTu Lab（腾讯优图实验室）
Optical coherence tomography (OCT) is a non-invasive imaging technology which can provide micrometer-resolution cross-sectional images of the inner structures of the eye. It is widely used for the diagnosis of ophthalmic diseases with retinal alteration, such as layer deformation and fluid accumulation. In this paper, a novel framework was proposed to segment retinal layers with fluid presence. The main contribution of this study is two folds: 1) we developed a cascaded network framework to incorporate the prior structural knowledge; 2) we proposed a novel deep neural network based on U-Net an…
Automated drusen segmentation in retinal optical coherence tomography (OCT) scans is relevant for understanding age-related macular degeneration (AMD) risk and progression. This task is usually performed by segmenting the top/bottom anatomical interfaces that define drusen, the outer boundary of the retinal pigment epithelium (OBRPE) and the Bruch's membrane (BM), respectively. In this paper we propose a novel multi-decoder architecture that tackles drusen segmentation as a multitask problem. Instead of training a multiclass model for OBRPE/BM segmentation, we use one decoder per target class …
Due to its noninvasive character, optical coherence tomography (OCT) has become a popular diagnostic method in clinical settings. However, the low-coherence interferometric imaging procedure is inevitably contaminated by heavy speckle noise, which impairs both visual quality and diagnosis of various ocular diseases. Although deep learning has been applied for image denoising and achieved promising results, the lack of well-registered clean and noisy image pairs makes it impractical for supervised learning-based approaches to achieve satisfactory OCT image denoising results. In this paper, we p…
Indian Institute of Information Technology, Sri City（印度信息技术学院，斯里城）
Image to Image Translation (I2I) is a challenging computer vision problem used in numerous domains for multiple tasks. Recently, ophthalmology became one of the major fields where the application of I2I is increasing rapidly. One such application is the generation of synthetic retinal optical coherence tomographic (OCT) scans. Existing I2I methods require training of multiple models to translate images from normal scans to a specific pathology: limiting the use of these models due to their complexity. To address this issue, we propose an unsupervised multi-domain I2I network with pre-trained s…
Clinical tracking systems are popular but typically require specific tracking markers. During the last years, scanning speed of optical coherence tomography (OCT) has increased to A-scan rates above 1 MHz allowing to acquire volume scans of moving objects. Thorefore, we propose a markerless tracking system based on OCT to obtain small volumetric images including information of sub-surface structures at high spatio-temporal resolution. In contrast to conventional vision based approaches, this allows identifying natural landmarks even for smooth and homogeneous surfaces. We describe the optomech…
Imperial College London（帝国理工学院）；UCLA（加州大学洛杉矶分校）；Jules Stein Eye Institute（朱尔斯·斯坦眼科研究所）；California State University（加州州立大学）；David Geffen School of Medicine（大卫·格芬医学院）；Technische Universität München（慕尼黑工业大学）
The estimation of glaucoma progression is a challenging task as the rate of disease progression varies among individuals in addition to other factors such as measurement variability and the lack of standardization in defining progression. Structural tests, such as thickness measurements of the retinal nerve fiber layer or the macula with optical coherence tomography (OCT), are able to detect anatomical changes in glaucomatous eyes. Such changes may be observed before any functional damage. In this work, we built a generative deep learning model using the conditional GAN architecture to predict…
Chromatic dispersion is a common problem to degrade the system resolution in optical coherence tomography (OCT). This study is to develop a deep learning network for automated dispersion compensation (ADC-Net) in OCT. The ADC-Net is based on a redesigned UNet architecture which employs an encoder-decoder pipeline. The input section encompasses partially compensated OCT B-scans with individual retinal layers optimized. Corresponding output is a fully compensated OCT B-scans with all retinal layers optimized. Two numeric parameters, i.e., peak signal to noise ratio (PSNR) and structural similari…
Simon Fraser University（西蒙弗雷泽大学）；Wake Forest University School of Medicine（维克森林大学医学院）；University of British Columbia（不列颠哥伦比亚大学）；University College London（伦敦大学学院）
Optical coherence tomography (OCT) captures cross-sectional data and is used for the screening, monitoring, and treatment planning of retinal diseases. Technological developments to increase the speed of acquisition often results in systems with a narrower spectral bandwidth, and hence a lower axial resolution. Traditionally, image-processing-based techniques have been utilized to reconstruct subsampled OCT data and more recently, deep-learning-based methods have been explored. In this study, we simulate reduced axial scan (A-scan) resolution by Gaussian windowing in the spectral domain and in…
The Pingry School（平格里学校）；Chinle Comprehensive Health Care Facility（钦利综合医疗中心）；University of Maryland, College Park（马里兰大学帕克分校）；NVIDIA（英伟达）
30 million Optical Coherence Tomography (OCT) imaging tests are issued annually to diagnose various retinal diseases, but accurate diagnosis of OCT scans requires trained eye care professionals who are still prone to making errors. With better systems for diagnosis, many cases of vision loss caused by retinal disease could be entirely avoided. In this work, we present ReLaX, a novel deep learning framework for explainable, accurate classification of retinal pathologies which achieves state-of-the-art accuracy. Furthermore, we emphasize producing both qualitative and quantitative explanations o…
