Purpose: Segmentation of liver vessels from CT images is indispensable prior to surgical planning and aroused broad range of interests in the medical image analysis community. Due to the complex structure and low contrast background, automatic liver vessel segmentation remains particularly challenging. Most of the related researches adopt FCN, U-net, and V-net variants as a backbone. However, these methods mainly focus on capturing multi-scale local features which may produce misclassified voxels due to the convolutional operator's limited locality reception field.
Methods: We propose a robust end-to-end vessel segmentation network called Inductive BIased Multi-Head Attention Vessel Net(IBIMHAV-Net) by expanding swin transformer to 3D and employing an effective combination of convolution and self-attention. In practice, we introduce the voxel-wise embedding rather than patch-wise embedding to locate precise liver vessel voxels, and adopt multi-scale convolutional operators to gain local spatial information. On the other hand, we propose the inductive biased multi-head self-attention which learns inductive biased relative positional embedding from initialized absolute position embedding. Based on this, we can gain a more reliable query and key matrix. To validate the generalization of our model, we test on samples which have different structural complexity.
Results: We conducted experiments on the 3DIRCADb datasets. The average dice and sensitivity of the four tested cases were 74.8% and 77.5%, which exceed results of existing deep learning methods and improved graph cuts method.
Conclusion: The proposed model IBIMHAV-Net provides an automatic, accurate 3D liver vessel segmentation with an interleaved architecture that better utilizes both global and local spatial features in CT volumes. It can be further extended for other clinical data.
The Second Hospital of Shandong University, Shandong University（山东大学第二医院，山东大学）；Shenzhen Third People’s Hospital, the Second Affiliated Hospital of Southern University of Science and Technology（深圳市第三人民医院，南方科技大学第二附属医院）；The First Affiliated Hospital of Hainan Medical University（海南医科大学第一附属医院）；Wuhan Asia General Hospital（武汉亚洲总医院）；Shanxi Medical University（山西医科大学）；Chengdu First People’s Hospital（成都市第一人民医院）；Keck School of Medicine, University of Southern California（南加州大学凯克医学院）；Shandong Provincial Hospital Affiliated to Shandong First Medical University（山东第一医科大学附属山东省立医院）
Despite high global prevalence of hepatic steatosis, no automated diagnostics demonstrated generalizability in detecting steatosis on multiple international datasets. Traditionally, hepatic steatosis detection relies on clinicians selecting the region of interest (ROI) on computed tomography (CT) to measure liver attenuation. ROI selection demands time and expertise, and therefore is not routinely performed in populations. To automate the process, we validated an existing artificial intelligence (AI) system for 3D liver segmentation and used it to purpose a novel method: AI-ROI, which could au…
SegKAN: High-Resolution Medical Image Segmentation with Long-Distance Dependencies
College of Computer Science and Artificial Intelligence, Southwest Minzu University（西南民族大学计算机科学与人工智能学院）；Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University（西安交通大学人工智能与机器人研究所）；College of Mechanical and Electrical Engineering, Northeast Forestry University（东北林业大学机电工程学院）；The Australian National University（澳大利亚国立大学）；University of Chinese Academy of Sciences（中国科学院大学）；Sichuan University（四川大学）；Department of Computer Science and Information Technology, La Trobe University（拉筹伯大学计算机科学与信息技术系）
Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）；Brigham and Women’s Hospital, Harvard Medical School（哈佛医学院布莱根妇女医院）；Tencent Jarvis Lab（腾讯天衍实验室）；Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）
Manually segmenting the hepatic vessels from Computer Tomography (CT) is far more expertise-demanding and laborious than other structures due to the low-contrast and complex morphology of vessels, resulting in the extreme lack of high-quality labeled data. Without sufficient high-quality annotations, the usual data-driven learning-based approaches struggle with deficient training. On the other hand, directly introducing additional data with low-quality annotations may confuse the network, leading to undesirable performance degradation. To address this issue, we propose a novel mean-teacher-ass…
Accurate hepatic vessel segmentation on ultrasound (US) images can be an important tool in the planning and execution of surgery, however proves to be a challenging task due to noise and speckle. Our method comprises a reduced filter 3D U-Net implementation to automatically detect hepatic vasculature in 3D US volumes. A comparison is made between volumes acquired with a 3D probe and stacked 2D US images based on electromagnetic tracking. Experiments are conducted on 67 scans, where 45 are used in training, 12 in validation and 10 in testing. This network architecture yields Dice scores of 0.74…
Explainable Convolutional Neural Networks for Retinal Fundus Classification and Cutting-Edge Segmentation Models for Retinal Blood Vessels from Fundus Images
Ahsanullah University of Science and Technology（阿萨努拉科技大学）
National Heart and Lung Institute, Faculty of Medicine, Imperial College London（帝国理工学院医学院国家心肺研究所）；Department of Bioengineering, Faculty of Engineering, Imperial College London（帝国理工学院工程系生物工程系）；Royal Brompton Hospital（皇家布朗普顿医院）
Various structures in human physiology follow a treelike morphology, which often expresses complexity at very fine scales. Examples of such structures are intrathoracic airways, retinal blood vessels, and hepatic blood vessels. Large collections of 2D and 3D images have been made available by medical imaging modalities such as magnetic resonance imaging (MRI), computed tomography (CT), Optical coherence tomography (OCT) and ultrasound in which the spatial arrangement can be observed. Segmentation of these structures in medical imaging is of great importance since the analysis of the structure …
Surgical resections are the most prevalent curative treatment for primary liver cancer. Tumors located in critical positions are known to complexify liver resections (LR). While experienced surgeons in specialized medical centers may have the necessary expertise to accurately anticipate LR complexity, and prepare accordingly, an objective method able to reproduce this behavior would have the potential to improve the standard routine of care, and avoid intra- and postoperative complications. In this article, we propose CoRe, an automated medical image processing pipeline for the prediction of p…
Qatar University（卡塔尔大学）；Hamad Medical Corporation（哈马德医疗公司）
Machine learning and computer vision techniques have grown rapidly in recent years due to their automation, suitability, and ability to generate astounding results. Hence, in this paper, we survey the key studies that are published between 2014 and 2022, showcasing the different machine learning algorithms researchers have used to segment the liver, hepatic tumors, and hepatic-vasculature structures. We divide the surveyed studies based on the tissue of interest (hepatic-parenchyma, hepatic-tumors, or hepatic-vessels), highlighting the studies that tackle more than one task simultaneously. Add…
Xiamen University（厦门大学）；Chinese PLA General Hospital（中国人民解放军总医院）；Deepwise AI Laboratory（深睿智慧人工智能实验室）
The analysis of organ vessels is essential for computer-aided diagnosis and surgical planning. But it is not a easy task since the fine-detailed connected regions of organ vessel bring a lot of ambiguity in vessel segmentation and sub-type recognition, especially for the low-contrast capillary regions. Furthermore, recent two-staged approaches would accumulate and even amplify these inaccuracies from the first-stage whole vessel segmentation into the second-stage sub-type vessel pixel-wise classification. Moreover, the scarcity of manual annotation in organ vessels poses another challenge. In …
Sun Yat-sen University（中山大学）；The First Affiliated Hospital, Sun Yat-sen University（中山大学附属第一医院）；Infervision Inc.（推想医疗科技股份有限公司）
Hepatocellular carcinoma (HCC) is the second most frequent cause of malignancy-related death and is one of the diseases with the highest incidence in the world. Because the liver is the only organ in the human body that is supplied by two major vessels: the hepatic artery and the portal vein, various types of malignant tumors can spread from other organs to the liver. And due to the liver masses' heterogeneous and diffusive shape, the tumor lesions are very difficult to be recognized, thus automatic lesion detection is necessary for the doctors with huge workloads. To assist doctors, this work…
NeuroVascU-Net: A Unified Multi-Scale and Cross-Domain Adaptive Feature Fusion U-Net for Precise 3D Segmentation of Brain Vessels in Contrast-Enhanced T1 MRI
School of Electrical and Computer Engineering, College of Engineering, University of Tehran（电信工程学院，工程学院，德黑兰大学）；Department of EECS, Lassonde School of Engineering, York University（电子工程系，拉索nde工程学院，约克大学）；Department of Neurosurgery, School of Medicine, Iran University of Medical Sciences（神经外科系，医学院，伊朗医学科学大学）；Department of Electrical and Computer Engineering, University of Waterloo（电子工程系，滑铁库大学）
Scale-specific auxiliary multi-task contrastive learning for deep liver vessel segmentation
LaTIM UMR 1101（拉蒂姆UMR 1101机构）；Inserm（法国国家健康与医学研究院）；University of Western Brittany（西布列塔尼大学）；University Hospital of Brest（布雷斯特大学医院）；University Hospital of Poitiers（普瓦捷大学医院）；ICube UMR 7357（ICube UMR 7357机构）；CNRS（法国国家科学研究中心）；IMT Atlantique（大西洋电信学院）
BreastSegNet: Multi-label Segmentation of Breast MRI
Department of Biostatistics \& Bioinformatics, Duke University Department of Electrical；Computer Engineering, Duke University Department of Radiology, Duke University Medical Center Department of Computer Science, Duke University
College of Engineering, Qatar University（卡塔尔大学工程学院）；Hamad Medical Corporation（哈马德医疗公司）
Machine learning and computer vision techniques have influenced many fields including the biomedical one. The aim of this paper is to investigate the important concept of schedulers in manipulating the learning rate (LR), for the liver segmentation task, throughout the training process, focusing on the newly devised OneCycleLR against the ReduceLRonPlateau. A dataset, published in 2018 and produced by the Medical Segmentation Decathlon Challenge organizers, called Task 8 Hepatic Vessel (MSDC-T8) has been used for testing and validation. The reported results that have the same number of maximum…
