Red-GAN: Attacking class imbalance via conditioned generation. Yet another perspective on medical image synthesis for skin lesion dermoscopy and brain tumor MRI
Technical University of Munich（慕尼黑工业大学）
Ahmad B Qasim, Ivan Ezhov, Suprosanna Shit, Oliver Schoppe, Johannes C Paetzold, Anjany Sekuboyina, Florian Kofler, Jana Lipkova, Hongwei Li, Bjoern Menze
发表信息：
Published in Proceedings of the 3rd edition of Medical Imaging with Deep Learning, Montréal, Canada, PMLR 121, 2020
Exploiting learning algorithms under scarce data regimes is a limitation and a reality of the medical imaging field. In an attempt to mitigate the problem, we propose a data augmentation protocol based on generative adversarial networks. We condition the networks at a pixel-level (segmentation mask) and at a global-level information (acquisition environment or lesion type). Such conditioning provides immediate access to the image-label pairs while controlling global class specific appearance of the synthesized images. To stimulate synthesis of the features relevant for the segmentation task, an additional passive player in a form of segmentor is introduced into the adversarial game. We validate the approach on two medical datasets: BraTS, ISIC. By controlling the class distribution through injection of synthetic images into the training set we achieve control over the accuracy levels of the datasets' classes.
University of Saskatchewan（萨斯喀彻温大学）；Philips Canada（加拿大飞利浦）
Melanoma is a curable aggressive skin cancer if detected early. Typically, the diagnosis involves initial screening with subsequent biopsy and histopathological examination if necessary. Computer aided diagnosis offers an objective score that is independent of clinical experience and the potential to lower the workload of a dermatologist. In the recent past, success of deep learning algorithms in the field of general computer vision has motivated successful application of supervised deep learning methods in computer aided melanoma recognition. However, large quantities of labeled images are re…
University of Barcelona（巴塞罗那大学）；Universitat Rovira i Virgili（罗维拉-维尔吉利大学）；Khalifa University of Science and Technology（哈利法科学技术大学）；Mil-kin Inc.（Mil-kin公司）；Dhaka Medical College Hospital（达卡医学院附属医院）；University of Warwick（华威大学）；University of Toulouse（图卢兹大学）
The determination of precise skin lesion boundaries in dermoscopic images using automated methods faces many challenges, most importantly, the presence of hair, inconspicuous lesion edges and low contrast in dermoscopic images, and variability in the color, texture and shapes of skin lesions. Existing deep learning-based skin lesion segmentation algorithms are expensive in terms of computational time and memory. Consequently, running such segmentation algorithms requires a powerful GPU and high bandwidth memory, which are not available in dermoscopy devices. Thus, this article aims to achieve …
FH Joanneum University of Applied Sciences（约阿内姆应用科学大学）
Skin cancer is the most common cancer worldwide, with melanoma being the deadliest form. Dermoscopy is a skin imaging modality that has shown an improvement in the diagnosis of skin cancer compared to visual examination without support. We evaluate the current state of the art in the classification of dermoscopic images based on the ISIC-2019 Challenge for the classification of skin lesions and current literature. Various deep neural network architectures pre-trained on the ImageNet data set are adapted to a combined training data set comprised of publicly available dermoscopic and clinical im…
Department of CS & IT, SUIT Peshawar（白沙瓦SUIT计算机科学与信息技术系）
Skin lesion segmentation can be rather a challenging task owing to the presence of artifacts, low contrast between lesion and boundary, color variegation, fuzzy skin lesion borders and heterogeneous background in dermoscopy images. In this paper, we propose a simple yet effective saliency-based approach derived in the frequency and spatial domain to detect pigmented skin lesion. Two color models are utilized for the construction of these maps. We suggest a different metric for each color model to design map in the spatial domain via color features. The map in the frequency domain is generated …
Hospital Clínic Barcelona, Universitat de Barcelona, IDIBAPS（巴塞罗那临床医院，巴塞罗那大学，IDIBAPS）；IBM Research AI, T J Watson Research Center（IBM研究AI，T J Watson研究中心）；Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center（医学部皮肤科，纪念斯隆-凯特琳癌症中心）；Kitware；Signal Theory and Communications, Universitat Politècnica de Catalunya（信号理论与通信，加泰罗尼亚理工大学）；Melanoma Unit, Dermatology Department, Hospital Clínic Barcelona, Universitat de Barcelona, IDIBAPS（黑素瘤科，皮肤科，巴塞罗那临床医院，巴塞罗那大学，IDIBAPS）
This article summarizes the BCN20000 dataset, composed of 19424 dermoscopic images of skin lesions captured from 2010 to 2016 in the facilities of the Hospital Clínic in Barcelona. With this dataset, we aim to study the problem of unconstrained classification of dermoscopic images of skin cancer, including lesions found in hard-to-diagnose locations (nails and mucosa), large lesions which do not fit in the aperture of the dermoscopy device, and hypo-pigmented lesions. The BCN20000 will be provided to the participants of the ISIC Challenge 2019, where they will be asked to train algorithms to c…
Central Electronics Engineering Research Institute, CSIR Madras Complex（CSIR马德拉斯综合体中央电子工程研究所）；University of Bridgeport（桥港大学）
Image segmentation and classification are the two main fundamental steps in pattern recognition. To perform medical image segmentation or classification with deep learning models, it requires training on large image dataset with annotation. The dermoscopy images (ISIC archive) considered for this work does not have ground truth information for lesion segmentation. Performing manual labelling on this dataset is time-consuming. To overcome this issue, self-learning annotation scheme was proposed in the two-stage deep learning algorithm. The two-stage deep learning algorithm consists of U-Net seg…
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；University of Science and Technology of China（中国科学技术大学）
Skin lesion segmentation is an important step for automatic melanoma diagnosis. Due to the non-negligible diversity of lesions from different patients, extracting powerful context for fine-grained semantic segmentation is still challenging today. Although the deep convolutional neural network (CNNs) have made significant improvements on skin lesion segmentation, they often fail to reserve the spatial details and long-range dependencies context due to consecutive convolution striding and pooling operations inside CNNs. In this paper, we formulate a cascaded context enhancement neural network fo…
Deeply Supervised Skin Lesions Diagnosis with Stage and Branch Attention
City University of Hong Kong（香港城市大学）；Beijing University of Posts and Telecommunications（北京邮电大学）；Shenzhen Research Institute, City University of Hong Kong（香港城市大学深圳研究院）
Indian Institute of Information Technology, Design and Manufacturing, Kancheepuram（印度信息技术与设计制造学院，坎奇普拉姆）
Skin cancer is the most common cancer in the existing world constituting one-third of the cancer cases. Benign skin cancers are not fatal, can be cured with proper medication. But it is not the same as the malignant skin cancers. In the case of malignant melanoma, in its peak stage, the maximum life expectancy is less than or equal to 5 years. But, it can be cured if detected in early stages. Though there are numerous clinical procedures, the accuracy of diagnosis falls between 49% to 81% and is time-consuming. So, dermoscopy has been brought into the picture. It helped in increasing the accur…
Xiamen University（厦门大学）；Xiamen University Malaysia（厦门大学马来西亚分校）；Manteia Technologies Co.,Ltd（曼泰亚科技有限公司）；The Chinese University of Hong Kong（香港中文大学）；The Hong Kong Polytechnic University（香港理工大学）
Skin lesion segmentation from dermoscopy images is of great importance for improving the quantitative analysis of skin cancer. However, the automatic segmentation of melanoma is a very challenging task owing to the large variation of melanoma and ambiguous boundaries of lesion areas. While convolutional neutral networks (CNNs) have achieved remarkable progress in this task, most of existing solutions are still incapable of effectively capturing global dependencies to counteract the inductive bias caused by limited receptive fields. Recently, transformers have been proposed as a promising tool …
Over the past few years, different computer-aided diagnosis (CAD) systems have been proposed to tackle skin lesion analysis. Most of these systems work only for dermoscopy images since there is a strong lack of public clinical images archive available to design them. To fill this gap, we release a skin lesion benchmark composed of clinical images collected from smartphone devices and a set of patient clinical data containing up to 22 features. The dataset consists of 1,373 patients, 1,641 skin lesions, and 2,298 images for six different diagnostics: three skin diseases and three skin cancers. …
Adapting Segment Anything Model 3 for Concept-Driven Lesion Segmentation in Medical Images: An Experimental Study
The Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center（德克萨斯大学西南医学中心放射肿瘤学系医学人工智能与自动化（MAIA）实验室）；Medical Image Processing Group, Department of Radiology, University of Pennsylvania（宾夕法尼亚大学放射学系医学图像处理组）；Division of Digestive and Liver Diseases, Department of Internal Medicine, University of Texas Southwestern Medical Center（德克萨斯大学西南医学中心内科学系消化与肝脏疾病科）
Synthetic Melanoma Image Generation and Evaluation Using Generative Adversarial Networks
Department of Engineering Technology, University of Houston（休斯顿大学工程技术系）；Department of Electrical and Computer Engineering, University of Houston（休斯顿大学电气与计算机工程系）；Department of Information Science Technology, University of Houston（休斯顿大学信息科学与技术系）；School of Computing, Clemson University（克莱姆斯大学计算学院）；Department of Public Health, Texas Tech University（德克萨斯技术大学公共卫生系）；Department of Dermatology and Pathology, Texas Tech University（德克萨斯技术大学皮肤科与病理学系）；Department of Dermatology, University of Texas MD Anderson Cancer Center（德克萨斯大学MD安德森癌症中心皮肤科）；Department of Biomedical Engineering, University of Houston（休斯顿大学生物医学工程系）
Image class translation: visual inspection of class-specific hypotheticals and classification based on translation distance
College of Natural Sciences, Colorado State University, Colorado, United States of America（科罗拉多州立大学自然科学院）；School of Biomedical and Chemical Engineering, Colorado State University, Colorado, United States of America（科罗拉多州立大学生物医学与化学工程学院）；Department of Electrical and Computer Engineering, Colorado State University, Colorado, United States of America（科罗拉多州立大学电气与计算机工程学院）
Skin cancer is one of the most common types of cancer around the world. For this reason, over the past years, different approaches have been proposed to assist detect it. Nonetheless, most of them are based only on dermoscopy images and do not take into account the patient clinical information. In this work, first, we present a new dataset that contains clinical images, acquired from smartphones, and patient clinical information of the skin lesions. Next, we introduce a straightforward approach to combine the clinical data and the images using different well-known deep learning models. These m…
SimulaMet；UiT The Arctic University of Norway（挪威北极大学）；Oslo Metropolitan University（奥斯陆城市大学）
Semantic image segmentation is the process of labeling each pixel of an image with its corresponding class. An encoder-decoder based approach, like U-Net and its variants, is a popular strategy for solving medical image segmentation tasks. To improve the performance of U-Net on various segmentation tasks, we propose a novel architecture called DoubleU-Net, which is a combination of two U-Net architectures stacked on top of each other. The first U-Net uses a pre-trained VGG-19 as the encoder, which has already learned features from ImageNet and can be transferred to another task easily. To capt…
