Enhancing Single-Slice Segmentation with 3D-to-2D Unpaired Scan Distillation
Vanderbilt University(范德堡大学);Nivida Corporation(英伟达公司);National Institute on Aging(国家衰老研究所)
Xin Yu, Qi Yang, Han Liu, Ho Hin Lee, Yucheng Tang, Lucas W. Remedios, Michael E. Kim, Rendong Zhang, Shunxing Bao, Yuankai Huo, Ann Zenobia Moore, Luigi Ferruc… 展开作者
Xin Yu, Qi Yang, Han Liu, Ho Hin Lee, Yucheng Tang, Lucas W. Remedios, Michael E. Kim, Rendong Zhang, Shunxing Bao, Yuankai Huo, Ann Zenobia Moore, Luigi Ferrucci, Bennett A. Landman
2D single-slice abdominal computed tomography (CT) enables the assessment of body habitus and organ health with low radiation exposure. However, single-slice data necessitates the use of 2D networks for segmentation, but these networks often struggle to capture contextual information effectively. Consequently, even when trained on identical datasets, 3D networks typically achieve superior segmentation results. In this work, we propose a novel 3D-to-2D distillation framework, leveraging pre-trained 3D models to enhance 2D single-slice segmentation. Specifically, we extract the prediction distribution centroid from the 3D representations, to guide the 2D student by learning intra- and inter-class correlation. Unlike traditional knowledge distillation methods that require the same data input, our approach employs unpaired 3D CT scans with any contrast to guide the 2D student model. Experiments conducted on 707 subjects from the single-slice Baltimore Longitudinal Study of Aging (BLSA) dataset demonstrate that state-of-the-art 2D multi-organ segmentation methods can benefit from the 3D teacher model, achieving enhanced performance in single-slice multi-organ segmentation. Notably, our approach demonstrates considerable efficacy in low-data regimes, outperforming the model trained with all available training subjects even when utilizing only 200 training subjects. Thus, this work underscores the potential to alleviate manual annotation burdens.
Tissue Segmentation of Thick-Slice Fetal Brain MR Scans with Guidance from High-Quality Isotropic Volumes
ShanghaiTech University(上海科技大学);Fudan University(复旦大学);Obstetrics and Gynecology Hospital of Fudan University(复旦大学附属妇产科医院);Northwestern Polytechnical University(西北工业大学);Shanghai United Imaging Intelligence company Ltd.(上海联影智能科技有限公司);Shanghai Clinical Research and Trial Center(上海临床研究中心)
SliceMamba with Neural Architecture Search for Medical Image Segmentation
School of Computer Science, Beijing University of Technology(北京工业大学计算机科学学院);Xiaomi Inc(小米公司);Department of Radiology, Capital Medical University Affiliated Beijing Friendship Hospital(首都医科大学附属北京友谊医院放射科);New Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所模式识别新实验室)
A Closer Look at Spatial-Slice Features Learning for COVID-19 Detection
Institute of Data Science, National Cheng Kung University(成功大学数据科学研究所);Department of Electrical Engineering, National Cheng Kung University(成功大学电机工程学系)
Simple 2D Convolutional Neural Network-based Approach for COVID-19 Detection
Institute of Data Science, National Cheng Kung University(国立成功大学数据科学学院);Department of Electrical Engineering, National Cheng Kung University(国立成功大学电机工程学系)
Xidian University(西安电子科技大学);Northwestern Polytechnical University(西北工业大学);Hefei Comprehensive National Science Center(合肥综合性国家科学中心);Nankai University(南开大学);City University of Hong Kong(香港城市大学)
Due to the constraints of the imaging device and high cost in operation time, computer tomography (CT) scans are usually acquired with low intra-slice resolution. Improving the intra-slice resolution is beneficial to the disease diagnosis for both human experts and computer-aided systems. To this end, this paper builds a novel medical slice synthesis to increase the between-slice resolution. Considering that the ground-truth intermediate medical slices are always absent in clinical practice, we introduce the incremental cross-view mutual distillation strategy to accomplish this task in the sel…
Huazhong University of Science and Technology(华中科技大学);Kennesaw State University(肯尼索州立大学)
The crossMoDA challenge aims to automatically segment the vestibular schwannoma (VS) tumor and cochlea regions of unlabeled high-resolution T2 scans by leveraging labeled contrast-enhanced T1 scans. The 2022 edition extends the segmentation task by including multi-institutional scans. In this work, we proposed an unpaired cross-modality segmentation framework using data augmentation and hybrid convolutional networks. Considering heterogeneous distributions and various image sizes for multi-institutional scans, we apply the min-max normalization for scaling the intensities of all scans between …
VoxelCloud Inc(体素科技公司);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Shanghai Jiao Tong University(上海交通大学)
Deep learning models tend to underperform in the presence of domain shifts. Domain transfer has recently emerged as a promising approach wherein images exhibiting a domain shift are transformed into other domains for augmentation or adaptation. However, with the absence of paired and annotated images, models merely learned by adversarial loss and cycle consistency loss could result in poor consistency of anatomy structures during the translation. Additionally, the complexity of learning multi-domain transfer could significantly increase with the number of target domains and source images. In t…
Shenzhen Deepcam Information Technologies(深圳深图信息技术有限公司);LinkSprite Technologies(联芯通科技)
We present an automatic COVID1-19 diagnosis framework from lung CT-scan slice images. In this framework, the slice images of a CT-scan volume are first proprocessed using segmentation techniques to filter out images of closed lung, and to remove the useless background. Then a resampling method is used to select one or multiple sets of a fixed number of slice images for training and validation. A 3D CNN network with BERT is used to classify this set of selected slice images. In this network, an embedding feature is also extracted. In cases where there are more than one set of slice images in a …
With the massive damage in the world caused by Coronavirus Disease 2019 SARS-CoV-2 (COVID-19), many related research topics have been proposed in the past two years. The Chest Computed Tomography (CT) scans are the most valuable materials to diagnose the COVID-19 symptoms. However, most schemes for COVID-19 classification of Chest CT scan is based on a single-slice level, implying that the most critical CT slice should be selected from the original CT scan volume manually. We simultaneously propose 2-D and 3-D models to predict the COVID-19 of CT scan to tickle this issue. In our 2-D model, we…
This paper investigates the application of deep learning models for lung Computed Tomography (CT) image analysis. Traditional deep learning frameworks encounter compatibility issues due to variations in slice numbers and resolutions in CT images, which stem from the use of different machines. Commonly, individual slices are predicted and subsequently merged to obtain the final result; however, this approach lacks slice-wise feature learning and consequently results in decreased performance. We propose a novel slice selection method for each CT dataset to address this limitation, effectively fi…
Inter-vendor harmonization of Computed Tomography (CT) reconstruction kernels using unpaired image translation
Vanderbilt University(范德堡大学);Vanderbilt University Medical Center(范德堡大学医学中心);Amsterdam University Medical Center(阿姆斯特丹大学医学中心);University of Amsterdam(阿姆斯特丹大学)
VinBigData JSC(VinBigData股份公司);VinUniversity(Vin大学);VinUni-Illinois Smart Health Center(VinUni-伊利诺伊智慧健康中心)
A fully automated system for interpreting abdominal computed tomography (CT) scans with multiple phases of contrast enhancement requires an accurate classification of the phases. This work aims at developing and validating a precise, fast multi-phase classifier to recognize three main types of contrast phases in abdominal CT scans. We propose in this study a novel method that uses a random sampling mechanism on top of deep CNNs for the phase recognition of abdominal CT scans of four different phases: non-contrast, arterial, venous, and others. The CNNs work as a slice-wise phase prediction, wh…
Promise and challenges of heart chamber segmentation from non-contrast CT scans using contrastive unpaired image translation: a feasibility study
Department of Radiology, University of Pittsburgh(匹兹堡大学放射科部门);Department of Bioengineering, University of Pittsburgh(匹兹堡大学生物工程部门);Department of Ophthalmology, University of Pittsburgh(匹兹堡大学眼科学部门)
Medical image translation has the potential to reduce the imaging workload, by removing the need to capture some sequences, and to reduce the annotation burden for developing machine learning methods. GANs have been used successfully to translate images from one domain to another, such as MR to CT. At present, paired data (registered MR and CT images) or extra supervision (e.g. segmentation masks) is needed to learn good translation models. Registering multiple modalities or annotating structures within each of them is a tedious and laborious task. Thus, there is a need to develop improved tra…
Indian Institute of Technology Indore(印度理工学院印多尔分校)
Alzheimer's Disease (AD) is a neurodegenerative disease that is one of the significant causes of death in the elderly population. Many deep learning techniques have been proposed to diagnose AD using Magnetic Resonance Imaging (MRI) scans. Predicting AD using 2D slices extracted from 3D MRI scans is challenging as the inter-slice information gets lost. To this end, we propose a novel and lightweight framework termed 'Biceph-Net' for AD diagnosis using 2D MRI scans that model both the intra-slice and inter-slice information. Biceph-Net has been experimentally shown to perform similar to other S…
The University of Maryland, College Park(马里兰大学帕克分校);University of Rochester(罗切斯特大学);Chinese Academy of Sciences(中国科学院);Peng Cheng Laboratory(鹏城实验室)
We propose a marginal super-resolution (MSR) approach based on 2D convolutional neural networks (CNNs) for interpolating an anisotropic brain magnetic resonance scan along the highly under-sampled direction, which is assumed to axial without loss of generality. Previous methods for slice interpolation only consider data from pairs of adjacent 2D slices. The possibility of fusing information from the direction orthogonal to the 2D slices remains unexplored. Our approach performs MSR in both sagittal and coronal directions, which provides an initial estimate for slice interpolation. The interpol…
Structural magnetic resonance imaging (MRI) has been widely utilized for analysis and diagnosis of brain diseases. Automatic segmentation of brain tumors is a challenging task for computer-aided diagnosis due to low-tissue contrast in the tumor subregions. To overcome this, we devise a novel pixel-wise segmentation framework through a convolutional 3D to 2D MR patch conversion model to predict class labels of the central pixel in the input sliding patches. Precisely, we first extract 3D patches from each modality to calibrate slices through the squeeze and excitation (SE) block. Then, the outp…
LPIXEL Inc.(LPIXEL公司);University of Cambridge(剑桥大学);National Institute of Informatics(国立信息学研究所);National Center for Global Health and Medicine(国立国际医疗研究中心);Juntendo University(顺天堂大学);ELTE Eötvös Loránd University(厄特沃什·罗兰大学);The University of Tokyo(东京大学)
Unsupervised learning can discover various unseen abnormalities, relying on large-scale unannotated medical images of healthy subjects. Towards this, unsupervised methods reconstruct a 2D/3D single medical image to detect outliers either in the learned feature space or from high reconstruction loss. However, without considering continuity between multiple adjacent slices, they cannot directly discriminate diseases composed of the accumulation of subtle anatomical anomalies, such as Alzheimer's Disease (AD). Moreover, no study has shown how unsupervised anomaly detection is associated with eith…
Engineering School of ITTCS Ural Federal University(乌拉尔联邦大学ITTCS工程学院);Institute of Natural Sciences Ural Federal University(乌拉尔联邦大学自然科学研究所);Laboratory of Translational Medicine and Bioinformatics Institute of Immunology and Physiology(免疫学与生理学研究所转化医学与生物信息学实验室);Laboratory of Immunophysiology and Immunopharmacology Institute of Immunology and Physiology(免疫学与生理学研究所免疫生理学与免疫药理学实验室)
Deep neural networks show high accuracy in theproblem of semantic and instance segmentation of biomedicaldata. However, this approach is computationally expensive. Thecomputational cost may be reduced with network simplificationafter training or choosing the proper architecture, which providessegmentation with less accuracy but does it much faster. In thepresent study, we analyzed the accuracy and performance ofUNet and ENet architectures for the problem of semantic imagesegmentation. In addition, we investigated the ENet architecture by replacing of some convolution layers with box-convolutio…
Institute of Medical Robotics, Shanghai Jiao Tong University(上海交通大学医疗机器人研究所);Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University(上海交通大学图像处理与模式识别研究所)
Purpose: Bronchoscopic intervention is a widely-used clinical technique for pulmonary diseases, which requires an accurate and topological complete airway map for its localization and guidance. The airway map could be extracted from chest computed tomography (CT) scans automatically by airway segmentation methods. Due to the complex tree-like structure of the airway, preserving its topology completeness while maintaining the segmentation accuracy is a challenging task. Methods: In this paper, a long-term slice propagation (LTSP) method is proposed for accurate airway segmentation from patholog…
Generating Synthetic Contrast-Enhanced Chest CT Images from Non-Contrast Scans Using Slice-Consistent Brownian Bridge Diffusion Network
Department of Medical Imaging, University of Saskatchewan(医学成像系,萨斯喀彻温大学);Department of Electrical and Computer Engineering, University of Saskatchewan(电气与计算机工程系,萨斯喀彻温大学)
Z 2 Sky Technologies Inc.(Z 2 天工科技公司);University of Rochester(罗切斯特大学);Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS(中国科学院计算技术研究所 中国科学院智能信息处理重点实验室);University of Science and Technology of China(中国科学技术大学);Suzhou Institute for Advance Research, University of Science and Technology of China(中国科学技术大学苏州高等研究院)
Spinal surgery planning necessitates automatic segmentation of vertebrae in cone-beam computed tomography (CBCT), an intraoperative imaging modality that is widely used in intervention. However, CBCT images are of low-quality and artifact-laden due to noise, poor tissue contrast, and the presence of metallic objects, causing vertebra segmentation, even manually, a demanding task. In contrast, there exists a wealth of artifact-free, high quality CT images with vertebra annotations. This motivates us to build a CBCT vertebra segmentation model using unpaired CT images with annotations. To overco…
We propose an automatic COVID1-19 diagnosis framework from lung CT-scan slice images using double BERT feature extraction. In the first BERT feature extraction, A 3D-CNN is first used to extract CNN internal feature maps. Instead of using the global average pooling, a late BERT temporal pooing is used to aggregate the temporal information in these feature maps, followed by a classification layer. This 3D-CNN-BERT classification network is first trained on sampled fixed number of slice images from every original CT scan volume. In the second stage, the 3D-CNN-BERT embedding features are extract…
Structure-Preserving Synthesis: MaskGAN for Unpaired MR-CT Translation
Australian Institute for Machine Learning, University of Adelaide(阿德莱德大学澳大利亚机器学习研究所);Flinders Health and Medical Research Institute, Flinders University(弗林德斯大学弗林德斯健康与医学研究所)
University College London(伦敦大学学院);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Massachusetts Institute of Technology(麻省理工学院)
Most existing algorithms for automatic 3D morphometry of human brain MRI scans are designed for data with near-isotropic voxels at approximately 1 mm resolution, and frequently have contrast constraints as well - typically requiring T1 scans (e.g., MP-RAGE). This limitation prevents the analysis of millions of MRI scans acquired with large inter-slice spacing ("thick slice") in clinical settings every year. The inability to quantitatively analyze these scans hinders the adoption of quantitative neuroimaging in healthcare, and precludes research studies that could attain huge sample sizes and h…
University of Karachi(卡拉奇大学);Zhejiang University(浙江大学);Iqra University(伊克拉大学);Karachi Institute of Economics and Technology(卡拉奇经济与技术学院);King Abdulaziz University(阿卜杜勒阿齐兹国王大学)
Heart is one of the vital organs of human body. A minor dysfunction of heart even for a short time interval can be fatal, therefore, efficient monitoring of its physiological state is essential for the patients with cardiovascular diseases. In the recent past, various computer assisted medical imaging systems have been proposed for the segmentation of the organ of interest. However, for the segmentation of heart using MRI, only few methods have been proposed each with its own merits and demerits. For further advancement in this area of research, we analyze automated heart segmentation methods …
Memorial Sloan Kettering Cancer Center(纪念斯隆·凯特琳癌症中心)
Accurate and robust segmentation of lung cancers from CT, even those located close to mediastinum, is needed to more accurately plan and deliver radiotherapy and to measure treatment response. Therefore, we developed a new cross-modality educed distillation (CMEDL) approach, using unpaired CT and MRI scans, whereby an informative teacher MRI network guides a student CT network to extract features that signal the difference between foreground and background. Our contribution eliminates two requirements of distillation methods: (i) paired image sets by using an image to image (I2I) translation a…
Computer-Aided-Diagnosis (CADx) systems assist radiologists with identifying and classifying potentially malignant pulmonary nodules on chest CT scans using morphology and texture-based (radiomic) features. However, radiomic features are sensitive to differences in acquisitions due to variations in dose levels and slice thickness. This study investigates the feasibility of generating a normalized scan from heterogeneous CT scans as input. We obtained projection data from 40 low-dose chest CT scans, simulating acquisitions at 10%, 25% and 50% dose and reconstructing the scans at 1.0mm and 2.0mm…
Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院(KAIST));Seoul National University College of Medicine, Seoul National University Bundang Hospital(首尔大学医学院,首尔大学盆唐医院)
Recently, deep learning approaches for accelerated MRI have been extensively studied thanks to their high performance reconstruction in spite of significantly reduced runtime complexity. These neural networks are usually trained in a supervised manner, so matched pairs of subsampled and fully sampled k-space data are required. Unfortunately, it is often difficult to acquire matched fully sampled k-space data, since the acquisition of fully sampled k-space data requires long scan time and often leads to the change of the acquisition protocol. Therefore, unpaired deep learning without matched la…
New York University Tandon School of Engineering(纽约大学坦登工程学院)
Deep networks are now ubiquitous in large-scale multi-center imaging studies. However, the direct aggregation of images across sites is contraindicated for downstream statistical and deep learning-based image analysis due to inconsistent contrast, resolution, and noise. To this end, in the absence of paired data, variations of Cycle-consistent Generative Adversarial Networks have been used to harmonize image sets between a source and target domain. Importantly, these methods are prone to instability, contrast inversion, intractable manipulation of pathology, and steganographic mappings which l…
Indian Institute of Technology Madras (IITM)(印度理工学院马德拉斯分校);Healthcare Technology Innovation Centre (HTIC), IITM(印度理工学院马德拉斯分校医疗技术创新中心)
Magnetic Resonance Imaging (MRI) is a valuable clinical diagnostic modality for spine pathologies with excellent characterization for infection, tumor, degenerations, fractures and herniations. However in surgery, image-guided spinal procedures continue to rely on CT and fluoroscopy, as MRI slice resolutions are typically insufficient. Building upon state-of-the-art single image super-resolution, we propose a reference-based, unpaired multi-contrast texture-transfer strategy for deep learning based in-plane and across-plane MRI super-resolution. We use the scattering transform to relate the te…
COVID-19 is an infectious disease that causes respiratory problems similar to those caused by SARS-CoV (2003). Currently, swab samples are being used for its diagnosis. The most common testing method used is the RT-PCR method, which has high specificity but variable sensitivity. AI-based detection has the capability to overcome this drawback. In this paper, we propose a prospective method wherein we use chest CT scans to diagnose the patients for COVID-19 pneumonia. We use a set of open-source images, available as individual CT slices, and full CT scans from a private Indian Hospital to train …
Heidelberg University(海德堡大学);University Medical Center Mannheim(曼海姆大学医学中心)
At present, lesion segmentation is still performed manually (or semi-automatically) by medical experts. To facilitate this process, we contribute a fully-automatic lesion segmentation pipeline. This work proposes a method as a part of the LiTS (Liver Tumor Segmentation Challenge) competition for ISBI 17 and MICCAI 17 comparing methods for automatics egmentation of liver lesions in CT scans. By utilizing cascaded, densely connected 2D U-Nets and a Tversky-coefficient based loss function, our framework achieves very good shape extractions with high detection sensitivity, with competitive scores …
Purpose: The purpose of this study is to demonstrate a method for Specific Absorption Rate (SAR) reduction for T2-FLAIR MRI sequences at 7T by predicting the required adiabatic pulse power and scaling the amplitude in a slice-wise fashion. Methods: We used a TR-FOCI adiabatic pulse for spin inversion in a T2-FLAIR sequence to improve B1+ homogeneity and calculate the pulse power required for adiabaticity slice-by-slice to minimize the SAR. Drawing on the implicit B1+ inhomogeneity present in a standard localizer scan, 3D AutoAlign localizers and SA2RAGE B1+ maps were acquired in eight voluntee…
The University of Tokyo(东京大学);RIKEN Center for Advanced Intelligence Project(理化学研究所先进智能项目中心);Sakurabashi Watanabe Hospital(樱桥渡边医院)
Providing closed and well-connected boundaries of coronary artery is essential to assist cardiologists in the diagnosis of coronary artery disease (CAD). Recently, several deep learning-based methods have been proposed for boundary detection and segmentation in a medical image. However, when applied to coronary wall detection, they tend to produce disconnected and inaccurate boundaries. In this paper, we propose a novel boundary detection method for coronary arteries that focuses on the continuity and connectivity of the boundaries. In order to model the spatial continuity of consecutive image…
Memorial Sloan Kettering Cancer Center(纪念斯隆凯特琳癌症中心)
We developed a new joint probabilistic segmentation and image distribution matching generative adversarial network (PSIGAN) for unsupervised domain adaptation (UDA) and multi-organ segmentation from magnetic resonance (MRI) images. Our UDA approach models the co-dependency between images and their segmentation as a joint probability distribution using a new structure discriminator. The structure discriminator computes structure of interest focused adversarial loss by combining the generated pseudo MRI with probabilistic segmentations produced by a simultaneously trained segmentation sub-networ…
CLADE: Cycle Loss Augmented Degradation Enhancement for Unpaired Super-Resolution of Anisotropic Medical Images
University College London(伦敦大学学院);Institute of Cardiovascular Science(心血管科学研究所);Centre for Medical Imaging(医学影像中心);Frimley Health NHS Trust(弗林利健康 NHS 信托基金);UCL NHS Trust(伦敦大学学院 NHS 信托基金)
Imperial College London(伦敦帝国理工学院);Hammersmith Hospital(哈默史密斯医院);Imperial College Healthcare NHS Trust(帝国理工学院医疗保健国民保健服务信托基金)
Objective: To demonstrate the effectiveness of using a deep learning-based approach for a fully automated slice-based measurement of muscle mass for assessing sarcopenia on CT scans of the abdomen without any case exclusion criteria. Materials and Methods: This retrospective study was conducted using a collection of public and privately available CT images (n = 1070). The method consisted of two stages: slice detection from a CT volume and single-slice CT segmentation. Both stages used Fully Convolutional Neural Networks (FCNN) and were based on a UNet-like architecture. Input data consisted o…
Amrita School of Engineering(阿姆里塔工程学院);Amrita Vishwa Vidyapeetham(阿姆里塔大学);Inception Institute of Artificial Intelligence(起源人工智能研究院);University of Canberra(堪培拉大学)
Diagnosis of Autism Spectrum Disorder (ASD) using clinical evaluation (cognitive tests) is challenging due to wide variations amongst individuals. Since no effective treatment exists, prompt and reliable ASD diagnosis can enable the effective preparation of treatment regimens. This paper proposes structural Magnetic Resonance Imaging (sMRI)-based ASD diagnosis via an outlier detection approach. To learn Spatio-temporal patterns in structural brain connectivity, a Generative Adversarial Network (GAN) is trained exclusively with sMRI scans of healthy subjects. Given a stack of three adjacent sli…
University of Surrey(萨里大学);Children’s National Hospital(国家儿童医院);Surrey Institute for People-Centred AI(萨里以人为本人工智能研究所)
The availability of large scale data with high quality ground truth labels is a challenge when developing supervised machine learning solutions for healthcare domain. Although, the amount of digital data in clinical workflows is increasing, most of this data is distributed on clinical sites and protected to ensure patient privacy. Radiological readings and dealing with large-scale clinical data puts a significant burden on the available resources, and this is where machine learning and artificial intelligence play a pivotal role. Magnetic Resonance Imaging (MRI) for musculoskeletal (MSK) diagn…
MESAHA-Net: Multi-Encoders based Self-Adaptive Hard Attention Network with Maximum Intensity Projections for Lung Nodule Segmentation in CT Scan
Department of Computer Science and Engineering, Seoul National University(计算机科学与工程系,首尔国立大学);Center for Artificial Intelligence in Medicine and Imaging, HealthHub Co. Ltd.(医学与影像人工智能中心,HealthHub公司);Department of Electrical and Computer Engineering, The University of Alabama(电气与计算机工程系,阿拉巴马大学);Department of Electrical Engineering, COMSATS University Islamabad(电气工程系,COMSATS大学伊斯兰堡分校)
Southeast University(东南大学);Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing(江苏省医学信息处理联合国际研究实验室);Centre de Recherche en Information Biomédicale Sino-Français (CRIBs)(中法生物医学信息研究中心(CRIBs))
The nature of thick-slice scanning causes severe inter-slice discontinuities of 3D medical images, and the vanilla 2D/3D convolutional neural networks (CNNs) fail to represent sparse inter-slice information and dense intra-slice information in a balanced way, leading to severe underfitting to inter-slice features (for vanilla 2D CNNs) and overfitting to noise from long-range slices (for vanilla 3D CNNs). In this work, a novel mesh network (MNet) is proposed to balance the spatial representation inter axes via learning. 1) Our MNet latently fuses plenty of representation processes by embedding …