ResUNet++: An Advanced Architecture for Medical Image Segmentation
SimulaMet(西姆拉大都会研究所);Augere Medical AS(奥格医疗公司);UiT The Arctic University of Norway(挪威UiT北极大学);University of Oslo(奥斯陆大学);Oslo Metropolitan University(奥斯陆城市大学)
Debesh Jha, Pia H. Smedsrud, Michael A. Riegler, Dag Johansen, Thomas de Lange, Pal Halvorsen, Havard D. Johansen
备注:
7 pages, 3 figures, 21st IEEE International Symposium on Multimedia
Accurate computer-aided polyp detection and segmentation during colonoscopy examinations can help endoscopists resect abnormal tissue and thereby decrease chances of polyps growing into cancer. Towards developing a fully automated model for pixel-wise polyp segmentation, we propose ResUNet++, which is an improved ResUNet architecture for colonoscopic image segmentation. Our experimental evaluations show that the suggested architecture produces good segmentation results on publicly available datasets. Furthermore, ResUNet++ significantly outperforms U-Net and ResUNet, two key state-of-the-art deep learning architectures, by achieving high evaluation scores with a dice coefficient of 81.33%, and a mean Intersection over Union (mIoU) of 79.27% for the Kvasir-SEG dataset and a dice coefficient of 79.55%, and a mIoU of 79.62% with CVC-612 dataset.
Lagrange Duality and Compound Multi-Attention Transformer for Semi-Supervised Medical Image Segmentation
University of Macau(澳门大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Guangdong University of Technology(广东工业大学)
Medical Image Segmentation Using Advanced Unet: VMSE-Unet and VM-Unet CBAM+
School of Computer Engineering, Kalinga Institute of Industrial Technology (KIIT) Deemed to be University(计算机工程学院,基灵加工业技术学院(KIIT)被认定为大学);Department of Electrical and Electronics Engineering, BITS-Pilani, Pilani Campus(电气与电子工程系,BITS-帕利尼,帕利尼校区)
The medical imaging literature has witnessed remarkable progress in high-performing segmentation models based on convolutional neural networks. Despite the new performance highs, the recent advanced segmentation models still require large, representative, and high quality annotated datasets. However, rarely do we have a perfect training dataset, particularly in the field of medical imaging, where data and annotations are both expensive to acquire. Recently, a large body of research has studied the problem of medical image segmentation with imperfect datasets, tackling two major dataset limitat…
Pairwise Similarity Regularization for Semi-supervised Graph Medical Image Segmentation
College of Computer Science and Technology, National University of Defense Technology(国防科技大学计算机学院);Academy of Military Sciences(军事科学院);Peking University(北京大学);Hebei University of Technology(河北工业大学)
Mamba-Sea: A Mamba-based Framework with Global-to-Local Sequence Augmentation for Generalizable Medical Image Segmentation
Shanghai Jiao Tong University School of Medicine(上海交通大学医学院);National Institute of Healthcare Data Science(健康数据科学国家研究院);State Key Laboratory for Novel Software Technology(新型软件技术国家重点实验室);School of Computer Science and Engineering(计算机科学与工程学院);Key Lab of Computer Network and Information Integration(计算机网络与信息集成重点实验室);School of Electrical and Information Engineering(电气与信息工程学院);The University of Sydney(悉尼大学)
Diversity-enhanced Collaborative Mamba for Semi-supervised Medical Image Segmentation
School of Intelligence Science and Technology, Nanjing University(智能科学与技术学院、南京大学);School of Electrical and Information Engineering, The University of Sydney(电气与信息工程学院、悉尼大学)
College of Computer Science and Software Engineering(计算机与软件学院);Tencent Jarvis Lab(腾讯贾维斯实验室);College of Information Science and Electronic Engineering(信息与电子工程学院);Zhejiang University(浙江大学);University of Hong Kong(香港大学)
Considering the scarcity of medical data, most datasets in medical image analysis are an order of magnitude smaller than those of natural images. However, most Network Architecture Search (NAS) approaches in medical images focused on specific datasets and did not take into account the generalization ability of the learned architectures on unseen datasets as well as different domains. In this paper, we address this point by proposing to search for generalizable U-shape architectures on a composited dataset that mixes medical images from multiple segmentation tasks and domains creatively, which …
Large language models (LLMs) have recently demonstrated their potential in clinical applications, providing valuable medical knowledge and advice. For example, a large dialog LLM like ChatGPT has successfully passed part of the US medical licensing exam. However, LLMs currently have difficulty processing images, making it challenging to interpret information from medical images, which are rich in information that supports clinical decisions. On the other hand, computer-aided diagnosis (CAD) networks for medical images have seen significant success in the medical field by using advanced deep-le…
University of California Santa Barbara(加州大学圣巴巴拉分校);Washington University in St. Louis(圣路易斯华盛顿大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Cancer Center at Illinois(伊利诺伊癌症中心)
Purpose: To objectively assess new medical imaging technologies via computer-simulations, it is important to account for the variability in the ensemble of objects to be imaged. This source of variability can be described by stochastic object models (SOMs). It is generally desirable to establish SOMs from experimental imaging measurements acquired by use of a well-characterized imaging system, but this task has remained challenging. Approach: A generative adversarial network (GAN)-based method that employs AmbientGANs with modern progressive or multiresolution training approaches is proposed. …
A Review on the Integration of Artificial Intelligence and Medical Imaging in IVF Ovarian Stimulation
Danube Private University (DPU)(多瑙河私立大学);Kinderwunschzentrum an der Wien(维也纳生育中心);Research Center for Clinical AI-Research in Omics and Medical Data Science (CAROM)(组学与医学数据科学临床人工智能研究中心);Austrian Center for Medical Innovation and Technology (ACMIT)(奥地利医学创新与技术中心);Medical University of Vienna (MUV)(维也纳医科大学);Laboratory for Life Sciences and Technology (LiST)(生命科学与技术实验室);Technion – Israel Institute of Technology(以色列理工学院)
Beyond the common difficulties faced in the natural image captioning, medical report generation specifically requires the model to describe a medical image with a fine-grained and semantic-coherence paragraph that should satisfy both medical commonsense and logic. Previous works generally extract the global image features and attempt to generate a paragraph that is similar to referenced reports; however, this approach has two limitations. Firstly, the regions of primary interest to radiologists are usually located in a small area of the global image, meaning that the remainder parts of the ima…
Harbin Institute of Technology at Shenzhen(哈尔滨工业大学(深圳));Peng Cheng Laboratory(鹏城实验室)
Based on the Denoising Diffusion Probabilistic Model (DDPM), medical image segmentation can be described as a conditional image generation task, which allows to compute pixel-wise uncertainty maps of the segmentation and allows an implicit ensemble of segmentations to boost the segmentation performance. However, DDPM requires many iterative denoising steps to generate segmentations from Gaussian noise, resulting in extremely inefficient inference. To mitigate the issue, we propose a principled acceleration strategy, called pre-segmentation diffusion sampling DDPM (PD-DDPM), which is specially …
Tencent Javis Lab(腾讯杰维斯实验室);Tencent AI Lab(腾讯AI实验室)
Convolutional Neural Networks (CNNs) have advanced existing medical systems for automatic disease diagnosis. However, a threat to these systems arises that adversarial attacks make CNNs vulnerable. Inaccurate diagnosis results make a negative influence on human healthcare. There is a need to investigate potential adversarial attacks to robustify deep medical diagnosis systems. On the other side, there are several modalities of medical images (e.g., CT, fundus, and endoscopic image) of which each type is significantly different from others. It is more challenging to generate adversarial perturb…
In this paper, we present Crossing Aggregation Network (CAggNet), a novel densely connected semantic segmentation approach for medical image analysis. The crossing aggregation network improves the idea from deep layer aggregation and makes significant innovations in semantic and spatial information fusion. In CAggNet, the simple skip connection structure of general U-Net is replaced by aggregations of multi-level down-sampling and up-sampling layers, which is a new form of nested skip connection. This aggregation architecture enables the network to fuse both coarse and fine features interactiv…
COVID-19 is a new pulmonary disease which is driving stress to the hospitals due to the large number of cases worldwide. Imaging of lungs can play a key role in monitoring of the healthy status. Non-contrast chest computed tomography (CT) has been used for this purpose, mainly in China, with a significant success. However, this approach cannot be used massively mainly for both high risk and cost and in some countries also because this tool is not extensively available. Alternatively, chest X-ray, although less sensitive than CT-scan, can provide important information about the evolution of pul…