Image restoration is a challenging ill-posed problem which also has been a long-standing issue. In the past few years, the convolution neural networks (CNNs) almost dominated the computer vision and had achieved considerable success in different levels of vision tasks including image restoration. However, recently the Swin Transformer-based model also shows impressive performance, even surpasses the CNN-based methods to become the state-of-the-art on high-level vision tasks. In this paper, we proposed a restoration model called SUNet which uses the Swin Transformer layer as our basic block and then is applied to UNet architecture for image denoising. The source code and pre-trained models are available at https://github.com/FanChiMao/SUNet.
Semantic segmentation of brain tumors is a fundamental medical image analysis task involving multiple MRI imaging modalities that can assist clinicians in diagnosing the patient and successively studying the progression of the malignant entity. In recent years, Fully Convolutional Neural Networks (FCNNs) approaches have become the de facto standard for 3D medical image segmentation. The popular "U-shaped" network architecture has achieved state-of-the-art performance benchmarks on different 2D and 3D semantic segmentation tasks and across various imaging modalities. However, due to the limited…
Robert Bosch Center of Data Science and AI, IIT Madras(印度理工学院马德拉斯分校罗伯特·博世数据科学与人工智能中心);Indian Institute of Technology, Madras(印度理工学院马德拉斯分校)
In this work, we present our proposed method to segment the pulmonary arteries from the CT scans using Swin UNETR and U-Net-based deep neural network architecture. Six models, three models based on Swin UNETR, and three models based on 3D U-net with residual units were ensemble using a weighted average to make the final segmentation masks. Our team achieved a multi-level dice score of 84.36 percent through this method. The code of our work is available on the following link: https://github.com/akansh12/parse2022. This work is part of the MICCAI PARSE 2022 challenge.
Technische Universität München(慕尼黑工业大学);Fudan University(复旦大学);Huawei Technologies(华为技术有限公司)
In the past few years, convolutional neural networks (CNNs) have achieved milestones in medical image analysis. Especially, the deep neural networks based on U-shaped architecture and skip-connections have been widely applied in a variety of medical image tasks. However, although CNN has achieved excellent performance, it cannot learn global and long-range semantic information interaction well due to the locality of the convolution operation. In this paper, we propose Swin-Unet, which is an Unet-like pure Transformer for medical image segmentation. The tokenized image patches are fed into the …
University Hospital Essen(埃森大学医院);Cancer Research Center Cologne Essen(科隆埃森癌症研究中心);University Medicine Essen(埃森大学医学院);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);HIDSS4Health - Helmholtz Information and Data Science School for Health(亥姆霍兹健康信息与数据科学学院);University of Minho(米尼奥大学);Computer Algorithms for Medicine Laboratory(医学计算机算法实验室)
Tumor volume and changes in tumor characteristics over time are important biomarkers for cancer therapy. In this context, FDG-PET/CT scans are routinely used for staging and re-staging of cancer, as the radiolabeled fluorodeoxyglucose is taken up in regions of high metabolism. Unfortunately, these regions with high metabolism are not specific to tumors and can also represent physiological uptake by normal functioning organs, inflammation, or infection, making detailed and reliable tumor segmentation in these scans a demanding task. This gap in research is addressed by the AutoPET challenge, wh…
Background and objective: Parotid gland tumors account for approximately 2% to 10% of head and neck tumors. Preoperative tumor localization, differential diagnosis, and subsequent selection of appropriate treatment for parotid gland tumors are critical. However, the relative rarity of these tumors and the highly dispersed tissue types have left an unmet need for a subtle differential diagnosis of such neoplastic lesions based on preoperative radiomics. Recently, deep learning methods have developed rapidly, especially Transformer beats the traditional convolutional neural network in computer v…
SCUNet++: Swin-UNet and CNN Bottleneck Hybrid Architecture with Multi-Fusion Dense Skip Connection for Pulmonary Embolism CT Image Segmentation
Hangzhou Dianzi University(杭州电子科技大学);Second Affiliated Hospital of the Chinese University of Hong Kong(香港中文大学第二附属医院);Shenzhen Research Institute of Big Data(深圳市大数据研究院)
Swin-UMamba: Mamba-based UNet with ImageNet-based pretraining
Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院保罗·C·劳特伯生物医学成像研究中心);Peng Cheng Laboratory(鹏城实验室);University of Chinese Academy of Sciences(中国科学院大学);The University of Hong Kong(香港大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
This paper evaluates the performance of supervised and unsupervised deep learning models for denoising positron emission tomography (PET) images in the presence of reduced acquisition times. Our experiments consider 212 studies (56908 images), and evaluate the models using 2D (RMSE, SSIM) and 3D (SUVpeak and SUVmax error for the regions of interest) metrics. It was shown that, in contrast to previous studies, supervised models (ResNet, Unet, SwinIR) outperform unsupervised models (pix2pix GAN and CycleGAN with ResNet backbone and various auxiliary losses) in the reconstruction of 2D PET images…
Comparative and Interpretative Analysis of CNN and Transformer Models in Predicting Wildfire Spread Using Remote Sensing Data
Imperial College London(帝国理工学院);University of Cambridge(剑桥大学);University of Waterloo(滑铁卢大学);Institut Polytechnique de Paris(巴黎综合理工学院);EDF R&D(法国电力公司研发部门);CEREA;ENPC(巴黎路桥学院)
SST-DUNet: Automated preclinical functional MRI skull stripping using Smart Swin Transformer and Dense UNet
School of Information Technology, Carleton University(卡尔顿大学信息技术学院);Center for Translational NeuroImaging (CTNI), Northeastern University(东北大学转化神经影像学中心);College of Science and Humanity Studies, Prince Sattam Bin Abdulaziz University(萨塔姆·本·阿卜杜勒阿齐兹王子大学科学与人文研究学院);Tessellis Ltd.(泰塞利斯有限公司)
DualSwinUnet++: An Enhanced Swin-Unet Architecture With Dual Decoders For PTMC Segmentation
Department of Mechanical and Mechatronics Engineering(机械与机电工程系);University of Waterloo(滑铁卢大学);Department of Radiology Withsim Clinic Seongnam, Korea(Seongnam诊所放射科)
SwinCross: Cross-modal Swin Transformer for Head-and-Neck Tumor Segmentation in PET/CT Images
Philips Research North America(飞利浦北美研究院);Massachusetts General Hospital/Harvard Medical School(麻省总医院/哈佛医学院);The Center for Advanced Medical Computing and Analysis, Massachusetts General Hospital/Harvard Medical School(麻省总医院/哈佛医学院高级医学计算与分析中心)
Isfahan University of Technology(伊斯法罕理工大学);McMaster University(麦克马斯特大学);Seattle University(西雅图大学)
Recently, many attempts have been made to construct a transformer base U-shaped architecture, and new methods have been proposed that outperformed CNN-based rivals. However, serious problems such as blockiness and cropped edges in predicted masks remain because of transformers' patch partitioning operations. In this work, we propose a new U-shaped architecture for medical image segmentation with the help of the newly introduced focal modulation mechanism. The proposed architecture has asymmetric depths for the encoder and decoder. Due to the ability of the focal module to aggregate local and g…
DACA-Net: A Degradation-Aware Conditional Diffusion Network for Underwater Image Enhancement
The Hong Kong University of Science and Technology (Guangzhou), Southern Marine Science and Engineering Guangdong Laboratory (Guangzhou)(香港科学与技术大学(广州)、广东海洋工程科学实验室(广州));The Hong Kong University of Science(香港科学与技术大学);Engineering Guangdong Laboratory (Guangzhou)(广东工程实验室(广州))
Vision Transformers (ViT)s have recently become popular due to their outstanding modeling capabilities, in particular for capturing long-range information, and scalability to dataset and model sizes which has led to state-of-the-art performance in various computer vision and medical image analysis tasks. In this work, we introduce a unified framework consisting of two architectures, dubbed UNetFormer, with a 3D Swin Transformer-based encoder and Convolutional Neural Network (CNN) and transformer-based decoders. In the proposed model, the encoder is linked to the decoder via skip connections at…
Sano Centre for Computational Medicine(萨诺计算医学中心);Informatics Institute, University of Amsterdam(阿姆斯特丹大学信息学研究所);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院)
Cardiac Magnetic Resonance Imaging is commonly used for the assessment of the cardiac anatomy and function. The delineations of left and right ventricle blood pools and left ventricular myocardium are important for the diagnosis of cardiac diseases. Unfortunately, the movement of a patient during the CMR acquisition procedure may result in motion artifacts appearing in the final image. Such artifacts decrease the diagnostic quality of CMR images and force redoing of the procedure. In this paper, we present a Multi-task Swin UNEt TRansformer network for simultaneous solving of two tasks in the …
Going Beyond U-Net: Assessing Vision Transformers for Semantic Segmentation in Microscopy Image Analysis
Institute of Computer Science, University of Tartu(塔尔图大学计算机科学研究所);Center for Artificial Intelligence, Technical University of Applied Sciences Würzburg-Schweinfurt(维尔茨堡-施韦因富特应用技术大学人工智能中心);STACC
An Ensemble Approach for Brain Tumor Segmentation and Synthesis
Paul G. Allen School of Computer Science, University of Washington(华盛顿大学保罗G.艾伦计算机科学学院);Lawrence Berkeley National Laboratory(劳伦斯伯克利国家实验室);Department of Bioengineering, University of Washington(华盛顿大学生物工程系);Department of Electrical and Computer Engineering, University of Washington(华盛顿大学电气与计算机工程系);Department of Mechanical Engineering, University of Washington(华盛顿大学机械工程系);Watauga High School(沃托加高中);Department of Neurological Surgery, University of Washington(华盛顿大学神经外科系)
Explainable Convolutional Neural Networks for Retinal Fundus Classification and Cutting-Edge Segmentation Models for Retinal Blood Vessels from Fundus Images
Ahsanullah University of Science and Technology(阿萨努拉科技大学)
Tumor-aware augmentation with task-guided attention analysis improves rectal cancer segmentation from magnetic resonance images
Department of Medical Physics, Memorial Sloan Kettering Cancer Center(医学物理系,纪念斯隆凯特琳癌症中心);Department of Radiology, Memorial Sloan Kettering Cancer Center(放射学系,纪念斯隆凯特琳癌症中心);Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center(放射肿瘤学系,纪念斯隆凯特琳癌症中心);Department of Surgery, Memorial Sloan Kettering Cancer Center(外科系,纪念斯隆凯特琳癌症中心);Department of Medicine, Memorial Sloan Kettering Cancer Center(医学系,纪念斯隆凯特琳癌症中心)
Here Comes the Explanation: A Shapley Perspective on Multi-contrast Medical Image Segmentation
University of Washington(华盛顿大学);Paul G. Allen School of Computer Science, University of Washington(华盛顿大学保罗·G·艾伦计算机科学学院);Department of Neurological Surgery, University of Washington(华盛顿大学神经外科(注:此处按要求提取到学院/大学级别,实际原文该机构属于华盛顿大学,故提取为华盛顿大学))