The automatic segmentation of blood vessels in fundus images can help analyze the condition of retinal vasculature, which is crucial for identifying various systemic diseases like hypertension, diabetes, etc. Despite the success of Deep Learning-based models in this segmentation task, most of them are heavily parametrized and thus have limited use in practical applications. This paper proposes IterMiUnet, a new lightweight convolution-based segmentation model that requires significantly fewer parameters and yet delivers performance similar to existing models. The model makes use of the excellent segmentation capabilities of Iternet architecture but overcomes its heavily parametrized nature by incorporating the encoder-decoder structure of MiUnet model within it. Thus, the new model reduces parameters without any compromise with the network's depth, which is necessary to learn abstract hierarchical concepts in deep models. This lightweight segmentation model speeds up training and inference time and is potentially helpful in the medical domain where data is scarce and, therefore, heavily parametrized models tend to overfit. The proposed model was evaluated on three publicly available datasets: DRIVE, STARE, and CHASE-DB1. Further cross-training and inter-rater variability evaluations have also been performed. The proposed model has a lot of potential to be utilized as a tool for the early diagnosis of many diseases.
East China Normal University（华东师范大学）；Ryerson University（瑞尔森大学）
Sturge-Weber syndrome (SWS) is a vascular malformation disease, and it may cause blindness if the patient's condition is severe. Clinical results show that SWS can be divided into two types based on the characteristics of scleral blood vessels. Therefore, how to accurately segment scleral blood vessels has become a significant problem in computer-aided diagnosis. In this research, we propose to continuously upsample the bottom layer's feature maps to preserve image details, and design a novel Claw UNet based on UNet for scleral blood vessel segmentation. Specifically, the residual structure is…
ITER, Siksha ‘O’ Anusandhan (Deemed to be University)（ITER，锡克沙·奥·阿努桑德汉（被视为大学））
In the medical domain, different computer-aided diagnosis systems have been proposed to extract blood vessels from retinal fundus images for the clinical treatment of vascular diseases. Accurate extraction of blood vessels from the fundus images using a computer-generated method can help the clinician to produce timely and accurate reports for the patient suffering from these diseases. In this article, we integrate top-hat based preprocessing approach with fine-tuned B-COSFIRE filter to achieve more accurate segregation of blood vessel pixels from the background. The use of top-hat transformat…
Cairo higher institute for engineering, computer sciences and management（开罗工程、计算机科学与管理高等学院）；Majmaah University（迈加马大学）；high institute of engineering Shock academy Cairo（开罗肖克学院工程高等学院）
Diabetic retinopathy is the basic reason for visual deficiency. This paper introduces a programmed strategy to identify and dispense with the blood vessels. The location of the blood vessels is the fundamental stride in the discovery of diabetic retinopathy because the blood vessels are the typical elements of the retinal picture. The location of the blood vessels can help the ophthalmologists to recognize the sicknesses prior and quicker. The blood vessels recognized and wiped out by utilizing Gobar filter on two freely accessible retinal databases which are STARE and DRIVE. The exactness of …
Australian Institute for Machine Learning（澳大利亚机器学习研究所）；The University of Adelaide（阿德莱德大学）；University of Nottingham（诺丁汉大学）；South Australian Health and Medical Research Institute（南澳大利亚健康与医学研究所）
Segmentation of cerebral blood vessels from Magnetic Resonance Imaging (MRI) is an open problem that could be solved with deep learning (DL). However, annotated data for training is often scarce. Due to the absence of open-source tools, we aim to develop a classical segmentation method that generates vessel ground truth from Magnetic Resonance Angiography for DL training of segmentation across a variety of modalities. The method combines size-specific Hessian filters, hysteresis thresholding and connected component correction. The optimal choice of processing steps was evaluated with a blinded…
The morphology of retinal blood vessels can indicate various diseases in the human body, and researchers have been working on automatic scanning and segmentation of retinal images to aid diagnosis. This project compares the performance of four neural network architectures in segmenting retinal images, using a combined dataset from different databases, namely the UNet, DR-VNet, UNet-ResNet and UNet-VGG.
Institute of Technical Education & Research, S‘O’A (Deemed to be University)（S‘O’A（被视为大学）技术教育与研究学院）
Blindness in diabetic patients caused by retinopathy (characterized by an increase in the diameter and new branches of the blood vessels inside the retina) is a grave concern. Many efforts have been made for the early detection of the disease using various image processing techniques on retinal images. However, most of the methods are plagued with the false detection of the blood vessel pixels. Given that, here, we propose a modified matched filter with the first derivative of Gaussian. The method uses the top-hat transform and contrast limited histogram equalization. Further, we segment the m…
Hangzhou Dianzi University（杭州电子科技大学）；Bauhaus University Weimar（魏玛包豪斯大学）
In this paper, a novel deep learning framework is proposed for temporal super-resolution simulation of blood vessel flows, in which a high-temporal-resolution time-varying blood vessel flow simulation is generated from a low-temporal-resolution flow simulation result. In our framework, point-cloud is used to represent the complex blood vessel model, resistance-time aided PointNet model is proposed for extracting the time-space features of the time-varying flow field, and finally we can reconstruct the high-accuracy and high-resolution flow field through the Decoder module. In particular, the a…
In recent years, several automatic segmentation methods have been proposed for blood vessels in retinal fundus images, ranging from using cheap and fast trainable filters to complicated neural networks and even deep learning. One example of a filted-based segmentation method is B-COSFIRE. In this approach the image filter is trained with example prototype patterns, to which the filter becomes selective by finding points in a Difference of Gaussian response on circles around the center with large intensity variation. In this paper we discuss and evaluate several of these vessel segmentation met…
Recursive Variational Autoencoders for 3D Blood Vessel Generative Modeling
Consejo Nacional de Investigaciones Científicas y Técnicas（阿根廷国家科学与技术研究院）；Universidad Torcuato Di Tella（托科托迪塔拉大学）；Depto. Ing. Eléctrica y Computadoras, Universidad Nacional del Sur（国家南部大学电子工程与计算机系）
Carotid artery vessel wall thickness measurement is an essential step in the monitoring of patients with atherosclerosis. This requires accurate segmentation of the vessel wall, i.e., the region between an artery's lumen and outer wall, in black-blood magnetic resonance (MR) images. Commonly used convolutional neural networks (CNNs) for semantic segmentation are suboptimal for this task as their use does not guarantee a contiguous ring-shaped segmentation. Instead, in this work, we cast vessel wall segmentation as a multi-task regression problem in a polar coordinate system. For each carotid a…
Bangladesh University of Engineering and Technology (BUET)（孟加拉国工程技术大学（BUET））；Georgia Institute of Technology（佐治亚理工学院）
Successful identification of blood vessel blockage is a crucial step for Alzheimer's disease diagnosis. These blocks can be identified from the spatial and time-depth variable Two-Photon Excitation Microscopy (TPEF) images of the brain blood vessels using machine learning methods. In this study, we propose several preprocessing schemes to improve the performance of these methods. Our method includes 3D-point cloud data extraction from image modality and their feature-space fusion to leverage complementary information inherent in different modalities. We also enforce the learned representation …
Federal University of São Carlos（圣卡洛斯联邦大学）；University of Ottawa（渥太华大学）；Ottawa Hospital Research Institute（渥太华医院研究所）
Characterizing blood vessels in digital images is important for the diagnosis of many types of diseases as well as for assisting current researches regarding vascular systems. The automated analysis of blood vessels typically requires the identification, or segmentation, of the blood vessels in an image or a set of images, which is usually a challenging task. Convolutional Neural Networks (CNNs) have been shown to provide excellent results regarding the segmentation of blood vessels. One important aspect of CNNs is that they can be trained on large amounts of data and then be made available, f…
MMM University of Technology（MMM理工大学）；National Institute of Technology, Hamirpur（哈米尔布尔国家理工学院）
Retinal blood vessels structure contains information about diseases like obesity, diabetes, hypertension and glaucoma. This information is very useful in identification and treatment of these fatal diseases. To obtain this information, there is need to segment these retinal vessels. Many kernel based methods have been given for segmentation of retinal vessels but their kernels are not appropriate to vessel profile cause poor performance. To overcome this, a new and efficient kernel based matched filter approach has been proposed. The new matched filter is used to generate the matched filter re…
Simulation-Based Segmentation of Blood Vessels in Cerebral 3D OCTA Images
University of Zurich（苏黎世大学）；ETH Zurich（苏黎世联邦理工学院）；Imperial College London（伦敦帝国学院）；Technical University of Munich（慕尼黑工业大学）；University Hospital Zurich（苏黎世大学医院）；Toronto Western Hospital（多伦多西部医院）；Krembil Research Institute（克雷比尔研究所）
Fujian Agriculture and Forestry University（福建农林大学）；Digital Fujian Research Institute of Big Data for Agriculture and Forestry（数字福建农林大数据研究院）
Accurate segmentation of the blood vessels of the retina is an important step in clinical diagnosis of ophthalmic diseases. Many deep learning frameworks have come up for retinal blood vessels segmentation tasks. However, the complex vascular structure and uncertain pathological features make the blood vessel segmentation still very challenging. A novel U-shaped network named Multi-module Concatenation which is based on Atrous convolution and multi-kernel pooling is put forward to retinal vessels segmentation in this paper. The proposed network structure retains three layers the essential stru…
Heritage Institute of Technology（遗产理工学院）；Tata Consultancy Services（塔塔咨询服务公司）
Diabetic Retinopathy (DR) is a complication of long-standing, unchecked diabetes and one of the leading causes of blindness in the world. This paper focuses on improved and robust methods to extract some of the features of DR, viz. Blood Vessels and Exudates. Blood vessels are segmented using multiple morphological and thresholding operations. For the segmentation of exudates, k-means clustering and contour detection on the original images are used. Extensive noise reduction is performed to remove false positives from the vessel segmentation algorithm's results. The localization of Optic Disc …
Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences（中国科学院宁波材料技术与工程研究所慈溪生物医学工程研究所）；University of Liverpool（利物浦大学）；University of Southern California（南加州大学）；Southern University of Science and Technology（南方科技大学）；University of Chinese Academy of Sciences（中国科学院大学）
Optical Coherence Tomography Angiography (OCTA) has been increasingly used in the management of eye and systemic diseases in recent years. Manual or automatic analysis of blood vessel in 2D OCTA images (en face angiograms) is commonly used in clinical practice, however it may lose rich 3D spatial distribution information of blood vessels or capillaries that are useful for clinical decision-making. In this paper, we introduce a novel 3D vessel reconstruction framework based on the estimation of vessel depth maps from OCTA images. First, we design a network with structural constraints to predict…
Bioinformatics Institute（生物信息学研究所）；Universitat Rovira i Virgili（罗维拉-威尔吉利大学）
In this paper, we propose an efficient blood vessel segmentation method for the eye fundus images using adversarial learning with multiscale features and kernel factorization. In the generator network of the adversarial framework, spatial pyramid pooling, kernel factorization and squeeze excitation block are employed to enhance the feature representation in spatial domain on different scales with reduced computational complexity. In turn, the discriminator network of the adversarial framework is formulated by combining convolutional layers with an additional squeeze excitation block to differe…
The detection of retinal blood vessels, especially the changes of small vessel condition is the most important indicator to identify the vascular network of the human body. Existing techniques focused mainly on shape of the large vessels, which is not appropriate for the disconnected small and isolated vessels. Paying attention to the low contrast small blood vessel in fundus region, first time we proposed to combine graph based smoothing regularizer with the loss function in the U-net framework. The proposed regularizer treated the image as two graphs by calculating the graph laplacians on ve…
Siksha ‘O’ Anusandhan (Deemed to be University)（锡克沙奥阿努山丹大学（被认定为大学））；ITER, Siksha ‘O’ Anusandhan (Deemed to be University)（锡克沙奥阿努山丹大学（被认定为大学）ITER学院）；Center for the Internet of Things, ITER, Siksha ‘O’ Anusandhan (Deemed to be University)（锡克沙奥阿努山丹大学（被认定为大学）ITER学院物联网中心）
Extracting blood vessels from retinal fundus images plays a decisive role in diagnosing the progression in pertinent diseases. In medical image analysis, vessel extraction is a semantic binary segmentation problem, where blood vasculature needs to be extracted from the background. Here, we present an image enhancement technique based on the morphological preprocessing coupled with a scaled U-net architecture. Despite a relatively less number of trainable network parameters, the scaled version of U-net architecture provides better performance compare to other methods in the domain. We validated…
Laser Doppler holography is a planar blood flow imaging technique recently introduced in ophthalmology to image human retinal and choroidal blood flow non-invasively. Here we present a digital method based on the Doppler spectrum asymmetry that reveals the local direction of blood flow with respect to the optical axis in out-of-plane vessels. This directional information is overlaid on standard grayscale blood flow images to depict flow moving towards the camera in red and flow moving away from the camera in blue, as in ultrasound color Doppler imaging. We show that thanks to the strong contri…
INESC TEC（INESC TEC（葡萄牙系统与计算机工程技术研究所））；Faculty of Sciences of the University of Porto（波尔图大学理学院）
Blood vessel segmentation is one of the most studied topics in computer vision, due to its relevance in daily clinical practice. Despite the evolution the field has been facing, especially after the dawn of deep learning, important challenges are still not solved. One of them concerns the consistency of the topological properties of the vascular trees, given that the best performing methodologies do not directly penalize mistakes such as broken segments and end up producing predictions with disconnected trees. This is particularly relevant in graph-like structures, such as blood vessel trees, …
Philips Research Paris（飞利浦巴黎研究院）；Institut Imagine, Université Paris Cité（巴黎西岱大学想象研究所）；Université Paris Cité（巴黎西岱大学）；Hôpital Necker Enfants-Malades, APHP（巴黎公共援助医院集团内克儿童病院）；Sorbonne Université（索邦大学）；CNRS, LIP6（法国国家科学研究中心LIP6实验室）；Technology Innovation Institute（技术创新研究所）
Anatomical structures such as blood vessels in contrast-enhanced CT (ceCT) images can be challenging to segment due to the variability in contrast medium diffusion. The combined use of ceCT and contrast-free (CT) CT images can improve the segmentation performances, but at the cost of a double radiation exposure. To limit the radiation dose, generative models could be used to synthesize one modality, instead of acquiring it. The CycleGAN approach has recently attracted particular attention because it alleviates the need for paired data that are difficult to obtain. Despite the great performance…
Automated segmentation of vascular map in retinal images endeavors a potential benefit in diagnostic procedure of different ocular diseases. In this paper, we suggest a new unsupervised retinal blood vessel segmentation approach using top-hat transformation, contrast-limited adaptive histogram equalization (CLAHE), and 2-D Gabor wavelet filters. Initially, retinal image is preprocessed using top-hat morphological transformation followed by CLAHE to enhance only the blood vessel pixels in the presence of exudates, optic disc, and fovea. Then, multiscale 2-D Gabor wavelet filters are applied on …
Deep Learning Based Estimation of Blood Glucose Levels from Multidirectional Scleral Blood Vessel Imaging
Changsha Aier Eye Hospital（长沙艾尔眼科医院）；Aier Eye Hospital Group Co., Ltd（艾尔眼科医院集团有限公司）；Central South University AIER Eye Institute of Ophthalmology（中南大学AIER眼科院眼科研究所）；Central South University（中南大学）；German Research Center for Artificial Intelligence（德国人工智能研究中心）
Volume visualization is a method that displays three-dimensional (3D) data in two-dimensional (2D) space. Using 3D datasets instead of 2D traditional images improves the visualization of anatomical structures, and volume visualization helps radiologists and surgeons to review large datasets comprehensively so that diagnosis and treatment can be enhanced. In liver surgery, blood vessel detection is important. Liver vessels have various shapes and due to the presence of noise in the ultrasound images, they can be confused with noise. Suboptimal images can sometimes lead to surgical errors where …
Existing methods to reconstruct vascular structures from a computed tomography (CT) angiogram rely on injection of intravenous contrast to enhance the radio-density within the vessel lumen. However, pathological changes can be present in the blood lumen, vessel wall or a combination of both that prevent accurate reconstruction. In the example of aortic aneurysmal disease, a blood clot or thrombus adherent to the aortic wall within the expanding aneurysmal sac is present in 70-80% of cases. These deformations prevent the automatic extraction of vital clinically relevant information by current m…
University of Calgary（卡尔加里大学）；Istanbul Medipol University（伊斯坦布尔梅迪波尔大学）；University of Southern Denmark（南丹麦大学）
The vascular structure of blood vessels is important in diagnosing retinal conditions such as glaucoma and diabetic retinopathy. Accurate segmentation of these vessels can help in detecting retinal objects such as the optic disc and optic cup and hence determine if there are damages to these areas. Moreover, the structure of the vessels can help in diagnosing glaucoma. The rapid development of digital imaging and computer-vision techniques has increased the potential for developing approaches for segmenting retinal vessels. In this paper, we propose an approach for segmenting retinal vessels t…
Deep vessel segmentation with joint multi-prior encoding
LaTIM UMR 1101；Inserm（法国国家健康与医学研究院）；University of Western Brittany（西布列塔尼大学）；University Hospital of Brest（布雷斯特大学医院）；CONICET（阿根廷国家科学技术研究委员会）；ICube UMR 7357；CNRS（法国国家科学研究中心）；IMT Atlantique（大西洋电信学院）
Accurate visualization of liver tumors and their surrounding blood vessels is essential for noninvasive diagnosis and prognosis prediction of tumors. In medical image segmentation, there is still a lack of in-depth research on the simultaneous segmentation of liver tumors and peritumoral blood vessels. To this end, we collect the first liver tumor, and vessel segmentation benchmark datasets containing 52 portal vein phase computed tomography images with liver, liver tumor, and vessel annotations. In this case, we propose a 3D U-shaped Cross-Attention Network (UCA-Net) that utilizes a tailored …
Segmentation of retinal vessel images is critical to the diagnosis of retinopathy. Recently, convolutional neural networks have shown significant ability to extract the blood vessel structure. However, it remains challenging to refined segmentation for the capillaries and the edges of retinal vessels due to thickness inconsistencies and blurry boundaries. In this paper, we propose a novel deep neural network for retinal vessel segmentation based on shared decoder and pyramid-like loss (SPNet) to address the above problems. Specifically, we introduce a decoder-sharing mechanism to capture multi…
X-GAN: A Generative AI-Powered Unsupervised Model for Main Vessel Segmentation of Glaucoma Screening
Southern Methodist University（南方 Methodist 大学）；National Aeronautics and Space Administration（美国国家航空航天局）；University of Texas Southwestern Medical Center（德克萨斯西南医学中心）；Northeastern University（东北大学）
Early diagnosis of retinal diseases such as diabetic retinopathy has had the attention of many researchers. Deep learning through the introduction of convolutional neural networks has become a prominent solution for image-related tasks such as classification and segmentation. Most tasks in image classification are handled by deep CNNs pretrained and evaluated on imagenet dataset. However, these models do not always translate to the best result on other datasets. Devising a neural network manually from scratch based on heuristics may not lead to an optimal model as there are numerous hyperparam…
Optical coherence tomography angiography (OCTA) is an imaging technique that allows for non-invasive investigation of the microvasculature in the retina. OCTA uses laser light reflectance to measure moving blood cells. Hereby, it visualizes the blood flow in the retina and can be used for determining regions with more or less blood flow. OCTA images contain the capillary network together with larger blood vessels, and in this paper we propose a method that segments larger vessels, capillaries and background. The segmentation is obtained using a dictionary-based machine learning method that req…
Deepwise AI Lab（深度智耀人工智能实验室）；Northwestern Polytechnical University（西北工业大学）；Peking University（北京大学）
Analyzing the morphological attributes of blood vessels plays a critical role in the computer-aided diagnosis of many cardiovascular and ophthalmologic diseases. Although being extensively studied, segmentation of blood vessels, particularly thin vessels and capillaries, remains challenging mainly due to the lack of an effective interaction between local and global features. In this paper, we propose a novel deep learning model called PC-Net to segment retinal vessels and major arteries in 2D fundus image and 3D computed tomography angiography (CTA) scans, respectively. In PC-Net, the pyramid …
The Computer-Assisted Diagnosis systems could save workloads and give objective diagnostic to ophthalmologists. At first, feature extraction is a fundamental step. One of these retinal features is the fovea. The fovea is a small fossa on the fundus. The main vessels diverge from the optic nerve head and follow a specific course that can be geometrically modeled as a parabola, with a common vertex inside the optic nerve head and the fovea located along the apex of this parabola curve. Therefore, based on this assumption, the main retinal blood vessels are segmented and fitted to a parabolic mod…
Learned Local Attention Maps for Synthesising Vessel Segmentations
University of Leeds（利兹大学）；Centre for Computational Imaging and Simulation Technologies in Biomedicine (CISTIB)（生物医学计算成像与模拟技术中心（CISTIB））；NIHR Leeds Biomedical Research Centre (BRC)（利兹国家健康研究院生物医学研究中心（BRC））；Alan Turing Institute（艾伦图灵研究所）；KU Leuven（鲁汶大学）；Medical Imaging Research Center (MIRC)（医学成像研究中心（MIRC））
Benchmarking Retinal Blood Vessel Segmentation Models for Cross-Dataset and Cross-Disease Generalization
University of Ibadan（伊巴丹大学）；African Institute for Mathematical Sciences（非洲数学科学研究所）；Hertie Institute for AI in Brain Health（赫蒂脑健康人工智能研究所）；University of Tübingen（蒂宾根大学）；University of Bern（伯尔尼大学）；University College London（伦敦大学学院）；Tübingen AI Center（蒂宾根人工智能中心）
Tel Aviv University（特拉维夫大学）；Facebook AI Research（脸书人工智能研究院）
Recently developed methods for rapid continuous volumetric two-photon microscopy facilitate the observation of neuronal activity in hundreds of individual neurons and changes in blood flow in adjacent blood vessels across a large volume of living brain at unprecedented spatio-temporal resolution. However, the high imaging rate necessitates fully automated image analysis, whereas tissue turbidity and photo-toxicity limitations lead to extremely sparse and noisy imagery. In this work, we extend a recently proposed deep learning volumetric blood vessel segmentation network, such that it supports …
A Hybrid Framework for Blood Vessel Morphology Classification: Discrete Geometry-based Tortuosity Feature Measurement, Information Gain-based Feature Selection, and Random Forest Classification
North China University of Technology（华北理工大学）；Capital Medical University（首都医科大学）
