Deep learning has achieved notable performance in the denoising task of low-quality medical images and the detection task of lesions, respectively. However, existing low-quality medical image denoising approaches are disconnected from the detection task of lesions. Intuitively, the quality of denoised images will influence the lesion detection accuracy that in turn can be used to affect the denoising performance. To this end, we propose a play-and-plug medical image denoising framework, namely Lesion-Inspired Denoising Network (LIDnet), to collaboratively improve both denoising performance and detection accuracy of denoised medical images. Specifically, we propose to insert the feedback of downstream detection task into existing denoising framework by jointly learning a multi-loss objective. Instead of using perceptual loss calculated on the entire feature map, a novel region-of-interest (ROI) perceptual loss induced by the lesion detection task is proposed to further connect these two tasks. To achieve better optimization for overall framework, we propose a customized collaborative training strategy for LIDnet. On consideration of clinical usability and imaging characteristics, three low-dose CT images datasets are used to evaluate the effectiveness of the proposed LIDnet. Experiments show that, by equipping with LIDnet, both of the denoising and lesion detection performance of baseline methods can be significantly improved.
We propose a novel deep learning model for classifying medical images in the setting where there is a large amount of unlabelled medical data available, but labelled data is in limited supply. We consider the specific case of classifying skin lesions as either malignant or benign. In this setting, the proposed approach -- the semi-supervised, denoising adversarial autoencoder -- is able to utilise vast amounts of unlabelled data to learn a representation for skin lesions, and small amounts of labelled data to assign class labels based on the learned representation. We analyse the contributions…
Fudan University（复旦大学）；Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University（复旦大学类脑智能科学与技术研究院）；Huashan Hospital, Fudan University（复旦大学附属华山医院）
Small lesions in magnetic resonance imaging (MRI) images are crucial for clinical diagnosis of many kinds of diseases. However, the MRI quality can be easily degraded by various noise, which can greatly affect the accuracy of diagnosis of small lesion. Although some methods for denoising MR images have been proposed, task-specific denoising methods for improving the diagnosis confidence of small lesions are lacking. In this work, we propose a voxel-wise hybrid residual MLP-CNN model to denoise three-dimensional (3D) MR images with small lesions. We combine basic deep learning architecture, MLP…
Indian Institute of Technology Madras（印度理工学院马德拉斯分校）；Sree Chitra Tirunal Institute for Medical Sciences and Technology（Sree Chitra Tirunal医学科学与技术研究所）
The work presented explores the use of denoising autoencoders (DAE) for brain lesion detection, segmentation and false positive reduction. Stacked denoising autoencoders (SDAE) were pre-trained using a large number of unlabeled patient volumes and fine tuned with patches drawn from a limited number of patients (n=20, 40, 65). The results show negligible loss in performance even when SDAE was fine tuned using 20 patients. Low grade glioma (LGG) segmentation was achieved using a transfer learning approach wherein a network pre-trained with High Grade Glioma (HGG) data was fine tuned using LGG im…
Canon Medical Research Europe（佳能医疗欧洲研究中心）；University of Glasgow（格拉斯哥大学）；University of Edinburgh（爱丁堡大学）；The Alan Turing Institute（艾伦·图灵研究所）
Pathological brain lesions exhibit diverse appearance in brain images, in terms of intensity, texture, shape, size, and location. Comprehensive sets of data and annotations are difficult to acquire. Therefore, unsupervised anomaly detection approaches have been proposed using only normal data for training, with the aim of detecting outlier anomalous voxels at test time. Denoising methods, for instance classical denoising autoencoders (DAEs) and more recently emerging diffusion models, are a promising approach, however naive application of pixelwise noise leads to poor anomaly detection perform…
Image denoising and high-level vision tasks are usually handled independently in the conventional practice of computer vision, and their connection is fragile. In this paper, we cope with the two jointly and explore the mutual influence between them with the focus on two questions, namely (1) how image denoising can help improving high-level vision tasks, and (2) how the semantic information from high-level vision tasks can be used to guide image denoising. First for image denoising we propose a convolutional neural network in which convolutions are conducted in various spatial resolutions via…
University of Goettingen（哥廷根大学）；Statistical and Applied Mathematical Science Institute（统计与应用数学科学研究所）
We consider the very challenging task of restoring images (i) which have a large number of missing pixels, (ii) whose existing pixels are corrupted by noise and (iii) the ideal image to be restored contains both cartoon and texture elements. The combination of these three properties makes this inverse problem a very difficult one. The solution proposed in this manuscript is based on directional global three-part decomposition (DG3PD) [ThaiGottschlich2016] with directional total variation norm, directional G-norm and $\ell_\infty$-norm in curvelet domain as key ingredients of the model. Image d…
DermoSegDiff: A Boundary-aware Segmentation Diffusion Model for Skin Lesion Delineation
University of Regensburg（雷根斯堡大学）；Iran University of Science and Technology（伊朗科技大学）；RWTH Aachen University（亚琛工业大学）；Fraunhofer Institute for Digital Medicine MEVIS（弗劳恩霍夫数字医学MEVIS研究所）
Nanyang Technological University（南洋理工大学）；Delft University of Technology（代尔夫特理工大学）
State-of-the-art image denoisers exploit various types of deep neural networks via deterministic training. Alternatively, very recent works utilize deep reinforcement learning for restoring images with diverse or unknown corruptions. Though deep reinforcement learning can generate effective policy networks for operator selection or architecture search in image restoration, how it is connected to the classic deterministic training in solving inverse problems remains unclear. In this work, we propose a novel image denoising scheme via Residual Recovery using Reinforcement Learning, dubbed R3L. W…
Amsterdam UMC（阿姆斯特丹大学医学中心）；University of Amsterdam（阿姆斯特丹大学）；MS Center Amsterdam（阿姆斯特丹多发性硬化中心）；Amsterdam Neuroscience（阿姆斯特丹神经科学研究所）；Vrije Universiteit Amsterdam（阿姆斯特丹自由大学）；Leiden University（莱顿大学）；Delft University of Technology（代尔夫特理工大学）
Machine Learning methods can learn how to reconstruct Magnetic Resonance Images and thereby accelerate acquisition, which is of paramount importance to the clinical workflow. Physics-informed networks incorporate the forward model of accelerated MRI reconstruction in the learning process. With increasing network complexity, robustness is not ensured when reconstructing data unseen during training. We aim to embed data consistency (DC) in deep networks while balancing the degree of network complexity. While doing so, we will assess whether either explicit or implicit enforcement of DC in varyin…
Fed-NDIF: A Noise-Embedded Federated Diffusion Model For Low-Count Whole-Body PET Denoising
Yale University（耶鲁大学）；Northwestern University（西北大学）；Ruijin Hospital, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属瑞金医院）；Inselspital, Bern University Hospital, University of Bern（伯尔尼大学医院 Inselspital，伯尔尼大学）；Technical University of Munich（慕尼黑工业大学）；Yale School of Medicine（耶鲁医学院）
Joint Medical Image Enhancement and Segmentation with Diffusion-based Symbiotic Information Interaction
Shenzhen Research Institute, The Chinese University of Hong Kong（香港中文大学深圳研究院）；University of Science and Technology of China（中国科学技术大学）；Imperial Global Singapore, Imperial College London（伦敦帝国学院新加坡分校）
Denoising Diffusion Models for 3D Healthy Brain Tissue Inpainting
University Hospital Basel（巴塞尔大学医院）；Helmholtz Center Munich（慕尼黑亥姆霍兹中心）；Helmholtz AI（亥姆霍兹人工智能）；Technical University of Munich（慕尼黑工业大学）；University of Basel（巴塞尔大学）；University of Zurich（苏黎世大学）；Klinikum rechts der Isar（伊斯河畔医院）；TranslaTUM - Central Institute for Translational Cancer Research（慕尼黑工业大学转化肿瘤学中央研究所（TranslaTUM））
SRUG: A Fusion-Driven Generator Network for Medical Image Translation
School of Electronic and Electrical Engineering, Shanghai University of Engineering Science（上海工程技术大学电子电气工程学院）；Department of Thoracic Surgery, Zhongshan Hospital of Fudan University（复旦大学中山医院胸外科）；Clinical Research Unit, Institute of Clinical Science, Zhongshan Hospital of Fudan University（复旦大学中山医院临床科研部）；Department of Medical Oncology, Cancer Center, and Fudan Zhangjiang Institute, Zhongshan Hospital of Fudan University（复旦大学中山医院医学肿瘤科、癌症中心及复旦张江研究院）
Low-resolution and signal-dependent noise distribution in positron emission tomography (PET) images makes denoising process an inevitable step prior to qualitative and quantitative image analysis tasks. Conventional PET denoising methods either over-smooth small-sized structures due to resolution limitation or make incorrect assumptions about the noise characteristics. Therefore, clinically important quantitative information may be corrupted. To address these challenges, we introduced a novel approach to remove signal-dependent noise in the PET images where the noise distribution was considere…
Most of the Deep Neural Networks (DNNs) based CT image denoising literature shows that DNNs outperform traditional iterative methods in terms of metrics such as the RMSE, the PSNR and the SSIM. In many instances, using the same metrics, the DNN results from low-dose inputs are also shown to be comparable to their high-dose counterparts. However, these metrics do not reveal if the DNN results preserve the visibility of subtle lesions or if they alter the CT image properties such as the noise texture. Accordingly, in this work, we seek to examine the image quality of the DNN results from a holis…
Lightweight Medical Image Restoration via Integrating Reliable Lesion-Semantic Driven Prior
University of Electronic Science and Technology of China（电子科技大学）；City University of Hong Kong（香港城市大学）；Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）；Shenzhen Institute For Advanced Study, University of Electronic Science and Technology of China（电子科技大学深圳研究院）
Xidian University（西安电子科技大学）；West Virginia University（西弗吉尼亚大学）
Neural architecture search (NAS) has recently reshaped our understanding on various vision tasks. Similar to the success of NAS in high-level vision tasks, it is possible to find a memory and computationally efficient solution via NAS with highly competent denoising performance. However, the optimization gap between the super-network and the sub-architectures has remained an open issue in both low-level and high-level vision. In this paper, we present a novel approach to filling in this gap by connecting model-guided design with NAS (MoD-NAS) and demonstrate its application into image denoisin…
Samsung Medical Center（三星医疗中心）；Sungkyunkwan University School of Medicine（成均馆大学医学院）；Sungkyunkwan University（成均馆大学）
The cone-beam computed tomography (CBCT) provides 3D volumetric imaging of a target with low radiation dose and cost compared with conventional computed tomography, and it is widely used in the detection of paranasal sinus disease. However, it lacks the sensitivity to detect soft tissue lesions owing to reconstruction constraints. Consequently, only physicians with expertise in CBCT reading can distinguish between inherent artifacts or noise and diseases, restricting the use of this imaging modality. The development of artificial intelligence (AI)-based computer-aided diagnosis methods for CBC…
Center for Data Science（数据科学中心）；New York University（纽约大学）；Center for Neural Science（神经科学中心）；Howard Hughes Medical Institute（霍华德·休斯医学研究所）；Courant Inst. of Mathematical Sciences（库朗数学科学研究所）
Deep convolutional networks often append additive constant ("bias") terms to their convolution operations, enabling a richer repertoire of functional mappings. Biases are also used to facilitate training, by subtracting mean response over batches of training images (a component of "batch normalization"). Recent state-of-the-art blind denoising methods (e.g., DnCNN) seem to require these terms for their success. Here, however, we show that these networks systematically overfit the noise levels for which they are trained: when deployed at noise levels outside the training range, performance degr…
SALIENT: Frequency-Aware Paired Diffusion for Controllable Long-Tail CT Detection
Trauma Radiology AI Laboratory (TRAIL)（创伤放射AI实验室）；Department of Radiology and Nuclear Medicine（放射科与核医学科）；University of Maryland School of Medicine（马里兰大学医学院）
Diffusion Models for Counterfactual Generation and Anomaly Detection in Brain Images
University of Edinburgh（爱丁堡大学）；NHS Lothian（洛锡安国民保健服务体系）；UK Dementia Research Institute Centre, University of Edinburgh（英国痴呆症研究所爱丁堡中心）；University of Dundee（邓迪大学）
Lung-DDPM+: Efficient Thoracic CT Image Synthesis using Diffusion Probabilistic Model
Centre de recherche du CHU de Québec-Université Laval（魁北克-拉瓦尔大学研究中心）；Department of Molecular Biology, Medical Biochemistry and Pathology, Université Laval（拉瓦尔大学分子生物学、医学生物化学与病理学系）；Cancer Research Center, Université Laval（拉瓦尔大学癌症研究中心）；Big Data Research Center, Université Laval（拉瓦尔大学大数据研究中心）；Department of Radiology, Carver College of Medicine - The University of Iowa（爱荷华大学卡弗医学院放射科）
