Ultrasound images are widespread in medical diagnosis for muscle-skeletal, cardiac, and obstetrical diseases, due to the efficiency and non-invasiveness of the acquisition methodology. However, ultrasound acquisition introduces noise in the signal, which corrupts the resulting image and affects further processing steps, e.g., segmentation and quantitative analysis. We define a novel deep learning framework for the real-time denoising of ultrasound images. Firstly, we compare state-of-the-art methods for denoising (e.g., spectral, low-rank methods) and select WNNM (Weighted Nuclear Norm Minimisation) as the best denoising in terms of accuracy, preservation of anatomical features, and edge enhancement. Then, we propose a tuned version of WNNM (tuned-WNNM) that improves the quality of the denoised images and extends its applicability to ultrasound images. Through a deep learning framework, the tuned-WNNM qualitatively and quantitatively replicates WNNM results in real-time. Finally, our approach is general in terms of its building blocks and parameters of the deep learning and high-performance computing framework; in fact, we can select different denoising algorithms and deep learning architectures.
During the past few years, inverse problem formulations of ultrasound beamforming have attracted a growing interest. They usually pose beamforming as a minimization problem of a fidelity term resulting from the measurement model plus a regularization term that enforces a certain class on the resulting image. Herein, we take advantages of alternating direction method of multipliers to propose a flexible framework in which each term is optimized separately. Furthermore, the proposed beamforming formulation is extended to replace the regularization term by a denoising algorithm, based on the rece…
B-mode ultrasound tongue imaging is widely used in the speech production field. However, efficient interpretation is in a great need for the tongue image sequences. Inspired by the recent success of unsupervised deep learning approach, we explore unsupervised convolutional network architecture for the feature extraction in the ultrasound tongue image, which can be helpful for the clinical linguist and phonetics. By quantitative comparison between different unsupervised feature extraction approaches, the denoising convolutional autoencoder (DCAE)-based method outperforms the other feature extra…
Denoising Plane Wave Ultrasound Images Using Diffusion Probabilistic Models
Concordia University（康考迪亚大学）；Sunnybrook Research Institute（桑尼布鲁克研究所）；INSA-Lyon（里昂国立应用科学学院）；UCBL（里昂第一大学）；CNRS（法国国家科学研究中心）；Inserm（法国国家健康与医学研究院）；Université de Lyon（里昂大学）
On one hand, the transmitted ultrasound beam gets attenuated as propagates through the tissue. On the other hand, the received Radio-Frequency (RF) data contains an additive Gaussian noise which is brought about by the acquisition card and the sensor noise. These two factors lead to a decreasing Signal to Noise Ratio (SNR) in the RF data with depth, effectively rendering deep regions of B-Mode images highly unreliable. There are three common approaches to mitigate this problem. First, increasing the power of transmitted beam which is limited by safety threshold. Averaging consecutive frames is…
Deep Neural Networks (DNNs) suffer from the performance degradation when image appearance shift occurs, especially in ultrasound (US) image segmentation. In this paper, we propose a novel and intuitive framework to remove the appearance shift, and hence improve the generalization ability of DNNs. Our work has three highlights. First, we follow the spirit of universal style transfer to remove appearance shifts, which was not explored before for US images. Without sacrificing image structure details, it enables the arbitrary style-content transfer. Second, accelerated with Adaptive Instance Norm…
UniUltra: Interactive Parameter-Efficient SAM2 for Universal Ultrasound Segmentation
School of Computer Science, University of Nottingham Ningbo China（Nottingham Ningbo中国大学计算机科学学院）；School of Computer Science, University of Nottingham, UK（Nottingham英国大学计算机科学学院）；School of Mathematical and Computational Sciences, Massey University（Massey大学数学与计算科学学院）；School of Data Science and Artificial Intelligence, Wenzhou University of Technology（温州科技大学数据科学与人工智能学院）；Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences（香港科学院创新研究所）；The Hong Kong Polytechnic University（香港理工大学）
School of Computer and Communication Sciences, EPFL（洛桑联邦理工学院计算机与通信科学学院）
Blind and universal image denoising consists of using a unique model that denoises images with any level of noise. It is especially practical as noise levels do not need to be known when the model is developed or at test time. We propose a theoretically-grounded blind and universal deep learning image denoiser for additive Gaussian noise removal. Our network is based on an optimal denoising solution, which we call fusion denoising. It is derived theoretically with a Gaussian image prior assumption. Synthetic experiments show our network's generalization strength to unseen additive noise levels…
Southeast University（东南大学）；Shanghai United-imaging Healthcare Co., Ltd（上海联影医疗科技股份有限公司）；University of Birmingham（伯明翰大学）
In order to improve speckle noise denoising of block matching 3d filtering (BM3D) method, an image frequency-domain multi-layer fusion enhancement method (MLFE-BM3D) based on nonsubsampled contourlet transform (NSCT) has been proposed. The method designs a NSCT hard threshold denoising enhancement to preprocess the image, then uses fusion enhancement in NSCT domain to fuse the preliminary estimation results of images before and after the NSCT hard threshold denoising, finally, BM3D denoising is carried out with the fused image to obtain the final denoising result. Experiments on natural images…
Speckle2Self: Self-Supervised Ultrasound Speckle Reduction Without Clean Data
Computer Aided Medical Procedures, Technical University of Munich, Munich, Germany（技术大学慕尼黑计算机辅助医疗程序）；Munich Center for Machine Learning (MCML), Munich, Germany（慕尼黑机器学习中心）
Korea Advanced Institute of Science and Technology (KAIST)（韩国科学技术院）
In ultrasound (US) imaging, individual channel RF measurements are back-propagated and accumulated to form an image after applying specific delays. While this time reversal is usually implemented using a hardware- or software-based delay-and-sum (DAS) beamformer, the performance of DAS decreases rapidly in situations where data acquisition is not ideal. Herein, for the first time, we demonstrate that a single data-driven adaptive beamformer designed as a deep neural network can generate high quality images robustly for various detector channel configurations and subsampling rates. The proposed…
Technion Institute of Technology（以色列理工学院）；Google Research（谷歌研究院）
Image denoising is a well studied problem with an extensive activity that has spread over several decades. Despite the many available denoising algorithms, the quest for simple, powerful and fast denoisers is still an active and vibrant topic of research. Leading classical denoising methods are typically designed to exploit the inner structure in images by modeling local overlapping patches, while operating in an unsupervised fashion. In contrast, recent newcomers to this arena are supervised and universal neural-network-based methods that bypass this modeling altogether, targeting the inferen…
Institut de Recherche en Informatique de Toulouse（图卢兹计算机科学研究所）；Université de Toulouse（图卢兹大学）；Laboratoire de Physique Théorique（理论物理实验室）；CNRS（法国国家科学研究中心）；UPS（巴黎萨克雷大学）；Université de Lyon（里昂大学）；INSA-Lyon（里昂国立应用科学学院）；Université Claude Bernard Lyon 1（里昂第一大学）；UJM-Saint Etienne（圣艾蒂安让·莫内大学）；Inserm（法国国家健康与医学研究院）；CREATIS（医学成像与信号处理研究中心）
Sparse representation of real-life images is a very effective approach in imaging applications, such as denoising. In recent years, with the growth of computing power, data-driven strategies exploiting the redundancy within patches extracted from one or several images to increase sparsity have become more prominent. This paper presents a novel image denoising algorithm exploiting such an image-dependent basis inspired by the quantum many-body theory. Based on patch analysis, the similarity measures in a local image neighborhood are formalized through a term akin to interaction in quantum mecha…
Universal Adversarial Defense in Remote Sensing Based on Pre-trained Denoising Diffusion Models
Helmholtz Institute Freiberg for Resource Technology（亥姆霍兹弗莱贝格资源技术研究所）；Helmholtz-Zentrum Dresden-Rossendorf (HZDR)（德累斯顿-罗森多夫亥姆霍兹中心）；Linköping University（林雪平大学）
Retinal optical coherence tomography (OCT) and OCT angiography (OCTA) suffer from the degeneration of image quality due to speckle noise and bulk-motion noise, respectively. Because the cross-sectional retina has distinct features in OCT and OCTA B-scans, existing digital filters that can denoise OCT efficiently are unable to handle the bulk-motion noise in OCTA. In this Letter, we propose a universal digital filtering approach that is capable of minimizing both types of noise. Considering the retinal capillaries in OCTA are hard to differentiate in B-scans while having distinct curvilinear st…
FetalCLIP: A Visual-Language Foundation Model for Fetal Ultrasound Image Analysis
Department of Computer Vision（计算机视觉系）；Mohamed bin Zayed University of Artificial Intelligence（马尔代夫比兹人工智能大学）；Department of Machine Learning（机器学习系）；Corniche Hospital, Abu Dhabi Health Services Company (SEHA)（阿布扎赫尔医院，阿布扎赫健康服务公司（SEHA））
Ultrasound (US) imaging is widely used for anatomical structure inspection in clinical diagnosis. The training of new sonographers and deep learning based algorithms for US image analysis usually requires a large amount of data. However, obtaining and labeling large-scale US imaging data are not easy tasks, especially for diseases with low incidence. Realistic US image synthesis can alleviate this problem to a great extent. In this paper, we propose a generative adversarial network (GAN) based image synthesis framework. Our main contributions include: 1) we present the first work that can synt…
Blind Ultrasound Image Enhancement via Self-Supervised Physics-Guided Degradation Modeling
Department of Computer Engineering, College of Computing and Mathematics, King Fahd University of Petroleum & Minerals (KFUPM)（计算机工程系，计算与数学学院，国王法赫德石油与矿物大学）；SDAIA–KFUPM Joint Research Center for Artificial Intelligence (JRC-AI), King Fahd University of Petroleum & Minerals（人工智能联合研究中心（JRC-AI），国王法赫德石油与矿物大学）；Department of Computer Science and Information Technology, Sir Syed University of Engineering and Technology (SSUET)（计算机科学与信息科技系，西德大学工程与技术学院）；Digital Technology & Innovation Center, Siemens Healthineers, Princeton, NJ 08540, USA（数字技术与创新中心，西门子健康部，美国新泽西州普林斯顿）；Department of Aerospace Engineering, King Fahd University of Petroleum & Minerals (KFUPM)（航空航天工程系，国王法赫德石油与矿物大学）；Interdisciplinary Research Center for Smart Mobility and Logistics, King Fahd University of Petroleum & Minerals (KFUPM)（智能交通与物流跨学科研究中心，国王法赫德石油与矿物大学）
Korea Advanced Institute of Science and Technology (KAIST)（韩国科学技术院）；Kim Jaechul Graduate School of AI（金在哲人工智能研究生院）
Recently, there has been extensive research interest in training deep networks to denoise images without clean reference. However, the representative approaches such as Noise2Noise, Noise2Void, Stein's unbiased risk estimator (SURE), etc. seem to differ from one another and it is difficult to find the coherent mathematical structure. To address this, here we present a novel approach, called Noise2Score, which reveals a missing link in order to unite these seemingly different approaches. Specifically, we show that image denoising problems without clean images can be addressed by finding the mod…
ECLIPSE: Expunging Clean-label Indiscriminate Poisons via Sparse Diffusion Purification
National Engineering Research Center for Big Data Technology and System（国家大数据技术与系统工程研究中心）；Hubei Engineering Research Center on Big Data Security（湖北省大数据安全工程研究中心）；School of Information and Communication Technology, Griffith University（格里菲斯大学信息与通信技术学院）；Services Computing Technology and System Lab（服务计算技术与系统实验室）；Cluster and Grid Computing Lab（集群与网格计算实验室）；Hubei Key Laboratory of Distributed System Security（湖北省分布式系统安全重点实验室）；School of Cyber Science and Engineering, Huazhong University of Science and Technology（华中科技大学网络空间科学与工程学院）
During the acquisition of an image from its source, noise always becomes an integral part of it. Various algorithms have been used in past to denoise the images. Image denoising still has scope for improvement. Visual information transmitted in the form of digital images has become a considerable method of communication in the modern age, but the image obtained after the transmission is often corrupted due to noise. In this paper, we review the existing denoising algorithms such as filtering approach and wavelets based approach and then perform their comparative study with bilateral filters. W…
