Ghost imaging (GI) has been paid attention gradually because of its lens-less imaging capability, turbulence-free imaging and high detection sensitivity. However, low image quality and slow imaging speed restrict the application process of GI. In this paper, we propose a improved GI method based on Denoising Convolutional Neural Networks (DnCNN). Inspired by the corresponding between input (noisy image) and output (residual image) in DnCNN, we construct the mapping between speckles sequence and the corresponding noise distribution in GI through training. Then, the same speckles sequence is employed to illuminate unknown targets, and a de-noising target image will be obtained. The proposed method can be regarded as a general method for GI. Under two sampling rates, extensive experiments are carried out to compare with traditional GI method (basic correlation and compressed sensing) and DnCNN method on three data sets. Moreover, we set up a physical GI experiment system to verify the proposed method. The results show that the proposed method achieves promising performance.
We study the influence rules of the speckle size of light source on ghost imaging, and propose a new type of speckle patterns to improve the quality of ghost imaging. The results show that the image quality will first increase and then decrease with the increase of the speckle size, and there is an optimal speckle size for a specific object. Moreover, by using the random distribution of speckle positions, a new type of displacement speckle patterns is designed, and the imaging quality is better than that of the random speckle patterns. These results are of great significances for finding the b…
Southeast University（东南大学）；Shanghai United-imaging Healthcare Co., Ltd（上海联影医疗科技股份有限公司）；University of Birmingham（伯明翰大学）
In order to improve speckle noise denoising of block matching 3d filtering (BM3D) method, an image frequency-domain multi-layer fusion enhancement method (MLFE-BM3D) based on nonsubsampled contourlet transform (NSCT) has been proposed. The method designs a NSCT hard threshold denoising enhancement to preprocess the image, then uses fusion enhancement in NSCT domain to fuse the preliminary estimation results of images before and after the NSCT hard threshold denoising, finally, BM3D denoising is carried out with the fused image to obtain the final denoising result. Experiments on natural images…
In this paper, we present a method for speckle pattern design using deep learning. The speckle patterns possess unique features after experiencing convolutions in Speckle-Net, our well-designed framework for speckle pattern generation. We then apply our method to the computational ghost imaging system. The standard deep learning-assisted ghost imaging methods use the network to recognize the reconstructed objects or imaging algorithms. In contrast, this innovative application optimizes the illuminating speckle patterns via Speckle-Net with specific sampling ratios. Our method, therefore, outpe…
We propose a computational ghost imaging scheme using customized pink noise speckle pattern illumination. By modulating the spatial frequency amplitude of the speckles, we generate speckle patterns with a significant positive spatial correlation. We experimentally reconstruct images using our synthesized speckle patterns in the presence of a variety of noise sources and pattern distortion and shown it is robust to noise interference. The results are compared with the use of standard white noise speckle patterns. We show that our method gives good image qualities under different noise interfere…
College of Information and Electrical Engineering, China Agricultural University（中国农业大学信息与电气工程学院）
In Synthetic Aperture Radar (SAR) imaging, despeckling is very important for image analysis,whereas speckle is known as a kind of multiplicative noise caused by the coherent imaging system. During the past three decades, various algorithms have been proposed to denoise the SAR image. Generally, the BM3D is considered as the state of art technique to despeckle the speckle noise with excellent performance. More recently, deep learning make a success in image denoising and achieved a improvement over conventional method where large train dataset is required. Unlike most of the images SAR image de…
Ghost imaging incorporating deep learning technology has recently attracted much attention in the optical imaging field. However, deterministic illumination and multiple exposure are still essential in most scenarios. Here we propose a ghost imaging scheme based on a novel conjugate-decoding deep learning framework (Y-net), which works well under both deterministic and indeterministic illumination. Benefited from the end-to-end characteristic of our network, the image of a sample can be achieved directly from a pair of correlated speckles collected by the detectors, and the sample is illuminat…
In this paper, we propose an advanced framework of ghost edge imaging, named compressed ghost edge imaging (CGEI). In the scheme, a set of structured speckle patterns with pixel shifting are illuminated on an unknown object, and the output is collected by a bucket detector without any spatial resolution. By using compressed sensing algorithm, we obtain the horizontal and vertical edge information of the unknown object with the bucket detector detection results and the known structured speckle patterns. The edge is finally constructed by the two-dimentional edge information. The experimental an…
Speckle2Self: Self-Supervised Ultrasound Speckle Reduction Without Clean Data
Computer Aided Medical Procedures, Technical University of Munich, Munich, Germany（技术大学慕尼黑计算机辅助医疗程序）；Munich Center for Machine Learning (MCML), Munich, Germany（慕尼黑机器学习中心）
Nowadays, target recognition technique plays an important role in many fields. However, the current target image information based methods suffer from the influence of image quality and the time cost of image reconstruction. In this paper, we propose a novel imaging-free target recognition method combining ghost imaging (GI) and generative adversarial networks (GAN). Based on the mechanism of GI, a set of random speckles sequence is employed to illuminate target, and a bucket detector without resolution is utilized to receive echo signal. The bucket signal sequence formed after continuous dete…
Ghost imaging has recently been successfully achieved in the X-ray regime; due to the penetrating power of X-rays this immediately opens up the possibility of X-ray ghost tomography. No research into this topic currently exists in the literature. Here we present adaptations of conventional tomography techniques to this new ghost imaging scheme. Several numerical implementations for tomography through X-ray ghost imaging are considered. Specific attention is paid to schemes for denoising of the resulting tomographic reconstruction, issues related to dose fractionation, and considerations regard…
Nirma University（尼玛大学）；Robert Bosch Engineering and Business Solutions Private Limited（博世工程和商业解决方案私人有限公司）；HEC Paris（巴黎高等商学院）
Synthetic Aperture Radar (SAR) images contain a huge amount of information, however, the number of practical use-cases is limited due to the presence of speckle noise in them. In recent years, deep learning based techniques have brought significant improvement in the domain of denoising and image restoration. However, further research has been hampered by the lack of availability of data suitable for training deep neural network based systems. With this paper, we propose a standard way of generating synthetic data for the training of speckle reduction algorithms and demonstrate a use-case to a…
Speckle reduction is a longstanding topic in synthetic aperture radar (SAR) images. Many different schemes have been proposed for the restoration of intensity SAR images. Among the different possible approaches, methods based on convolutional neural networks (CNNs) have recently shown to reach state-of-the-art performance for SAR image restoration. CNN training requires good training data: many pairs of speckle-free / speckle-corrupted images. This is an issue in SAR applications, given the inherent scarcity of speckle-free images. To handle this problem, this paper analyzes different strategi…
Télécom Paris, Institut Polytechnique de Paris（巴黎理工学院巴黎电信学院）；Laboratoire Hubert Curien（于贝尔·居里安实验室）
Deep learning approaches show unprecedented results for speckle reduction in SAR amplitude images. The wide availability of multi-temporal stacks of SAR images can improve even further the quality of denoising. In this paper, we propose a flexible yet efficient way to integrate temporal information into a deep neural network for speckle suppression. Archives provide access to long time-series of SAR images, from which multi-temporal averages can be computed with virtually no remaining speckle fluctuations. The proposed method combines this multi-temporal average and the image at a given date i…
Artificial intelligence has recently been widely used in computational imaging. The deep neural network (DNN) improves the signal-to-noise ratio of the retrieved images, whose quality is otherwise corrupted due to the low sampling ratio or noisy environments. This work proposes a new computational imaging scheme based on the sequence transduction mechanism with the transformer network. The simulation database assists the network in achieving signal translation ability. The experimental single-pixel detector's signal will be `translated' into a 2D image in an end-to-end manner. High-quality ima…
Benefit from the promising features of second-order correlation, ghost imaging (GI) has received extensive attentions in recent years. Simultaneously, GI is affected by the poor trade-off between sampling rate and imaging quality. The traditional image reconstruction method in GI is to accumulate the action result of each speckle and the corresponding bucket signal. We found that the image reconstruction process of GI is very similar to the Recurrent Neural Network (RNN), which is one of the deep learning algorithm. In this paper, we proposed a novel method that effectively implements GI on th…
Information extraction from synthetic aperture radar (SAR) images is heavily impaired by speckle noise, hence despeckling is a crucial preliminary step in scene analysis algorithms. The recent success of deep learning envisions a new generation of despeckling techniques that could outperform classical model-based methods. However, current deep learning approaches to despeckling require supervision for training, whereas clean SAR images are impossible to obtain. In the literature, this issue is tackled by resorting to either synthetically speckled optical images, which exhibit different propert…
A spectral camera based on ghost imaging via sparsity constraints (GISC) acquires a spectral data-cube (x; y; λ) through a single exposure. The noise immunity of the system is one of the important factors affecting the quality of the reconstructed images, especially at low sampling rates. Tailoring the intensity to generate super-Rayleigh speckle patterns which have superior noise immunity may offer an effective route to promote the imaging quality of GISC spectral camera. According to the structure of GISC spectral camera, we proposed a universal method for generating super-Rayleigh speckle p…
Ghost imaging LiDAR via sparsity constraints using push-broom scanning is proposed. It can image the stationary target scene continuously along the scanning direction by taking advantage of the relative movement between the platform and the target scene. Compared to conventional ghost imaging LiDAR that requires multiple speckle patterns staring the target, ghost imaging LiDAR via sparsity constraints using push-broom scanning not only simplifies the imaging system, but also reduces the sampling number. Numerical simulations and experiments have demonstrated its efficiency.
Optical coherence tomography (OCT) is a prevalent imaging technique for retina. However, it is affected by multiplicative speckle noise that can degrade the visibility of essential anatomical structures, including blood vessels and tissue layers. Although averaging repeated B-scan frames can significantly improve the signal-to-noise-ratio (SNR), this requires longer acquisition time, which can introduce motion artifacts and cause discomfort to patients. In this study, we propose a learning-based method that exploits information from the single-frame noisy B-scan and a pseudo-modality that is c…
We propose a new local-binary ghost imaging by using point-by-point method. This method can compensate the degradation of imaging quality due to the loss of information during binarization process. The numerical and experimental results show that the target details can be reconstructed well by this method when compared with traditional ghost imaging. By comparing the differences of the speckle patterns from different binarization methods, we also give the corresponding explanation. Our results may have the potential applications in areas with high requirements for imaging details, such as targ…
During the past few years, inverse problem formulations of ultrasound beamforming have attracted a growing interest. They usually pose beamforming as a minimization problem of a fidelity term resulting from the measurement model plus a regularization term that enforces a certain class on the resulting image. Herein, we take advantages of alternating direction method of multipliers to propose a flexible framework in which each term is optimized separately. Furthermore, the proposed beamforming formulation is extended to replace the regularization term by a denoising algorithm, based on the rece…
Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences（中国科学院上海光学精密机械研究所）
Ghost imaging radar is a new system of gaze imaging radar with high detection sensitivity, super-resolution and better anti-interference performance, but the relative motion between the radar system and the target will make the target imaging deteriorate. This paper proposes to perform absolute position localisation of a single target in the field of view by weighting the correlation strength of a single frame image of rough target, and to compensate translation of the reference arm speckle according to the localisation and tracking trajectory to accumulate the rough image into a high quality …
School of Biological Sciences and Medical Engineering, Southeast University（东南大学生物科学与医学工程学院）；Shanghai United-imaging Healthcare Co., Ltd（上海联影医疗科技股份有限公司）
The total variation method is widely used in image noise suppression. However, this method is easy to cause the loss of image details, and it is also sensitive to parameters such as iteration time. In this work, the total variation method has been modified using a diffusion rate adjuster based on the phase congruency and a fusion filter of median filter and phase consistency boundary, which is called the MPC-TV method. Experimental results indicate that MPC-TV method is effective in noise suppression, especially for the removing of speckle noise, and it can also improve the robustness of itera…
Light field modulation matrix is closely related to the quality of reconstructed image in ghost imaging. The orthogonality light field modulation matrix with better noise immunity and high quality reconstructed image is urgently needed in the practical application of ghost imaging. In this work, we propose a Gold matrix ghost imaging method with excellent imaging and anti-noise performance, which is proud of the pseudo-randomness and orthogonality of the deterministic Gold matrix. Numerical simulation and experimental results show that the Gold matrix has the characteristics of both random spe…
Due to its noninvasive character, optical coherence tomography (OCT) has become a popular diagnostic method in clinical settings. However, the low-coherence interferometric imaging procedure is inevitably contaminated by heavy speckle noise, which impairs both visual quality and diagnosis of various ocular diseases. Although deep learning has been applied for image denoising and achieved promising results, the lack of well-registered clean and noisy image pairs makes it impractical for supervised learning-based approaches to achieve satisfactory OCT image denoising results. In this paper, we p…
We present a framework for computational ghost imaging based on deep learning and customized pink noise speckle patterns. The deep neural network in this work, which can learn the sensing model and enhance image reconstruction quality, is trained merely by simulation. To demonstrate the sub-Nyquist level in our work, the conventional computational ghost imaging results, reconstructed imaging results using white noise and pink noise via deep learning are compared under multiple sampling rates at different noise conditions. We show that the proposed scheme can provide high-quality images with a …
Computational ghost imaging generally requires a large number of pattern illumination to obtain a high-quality image. The colored noise speckle pattern was recently proposed to substitute the white noise pattern in a variety of noisy environments and gave a significant signal-to-noise ratio enhancement even with a limited number of patterns. We propose and experimentally demonstrate here an orthonormalization approach based on the colored noise patterns to achieve sub-Nyquist computational ghost imaging. We tested the reconstructed image in quality indicators such as the contrast-to-noise rati…
Imaging and edge detection have been widely applied and played an important role in security checking and medical diagnosis. However, as we know, most edge detection based on ghost imaging system require a large measurement times and the target object image cannot be provided directly. In this work, a new edge detection based on joint iteration of projected Landweber iteration regularization and guided filter ghost imaging method have been proposed which can be improved the feature detection quality in ghost imaging. This method can also achieve high quality imaging. Simulation and experiment …
Optical image data have been used by the Remote Sensing workforce to study land use and cover since such data is easily interpretable. Synthetic Aperture Radar (SAR) has the characteristic of obtaining images during all-day, all-weather and provides object information that is different from visible and infrared sensors. However, SAR images have more speckle noise and fewer dimensions. This paper presents a method for denoising, feature extraction and compares classifications of Optical and SAR images. The image was denoised using K-Singular Value Decomposition (K-SVD) algorithm. A method to ma…
We present a ghost handwritten digit recognition method for the unknown handwritten digits based on ghost imaging (GI) with deep neural network, where a few detection signals from the bucket detector, generated by the Cosine Transform speckle, are used as the characteristic information and the input of the designed deep neural network (DNN), and the classification is designed as the output of the DNN. The results show that the proposed scheme has a higher recognition accuracy (as high as 98.14% for the simulations, and 92.9% for the experiments ) with a smaller sampling ratio (say 12.76%). Wit…
By encoding the high-dimensional light-field imaging information into a detectable two-dimensional speckle plane, ghost imaging camera via sparsity constraints (GISC camera) can directly catch the high-dimensional light-field imaging information with only one snapshot. This makes it worth to revisit the spatial resolution limit of this optical imaging system. In this paper we show both theoretically and experimentally that, while the resolution in high-dimensional light-field space is still limited by diffraction, the statistical spatial resolution of GISC camera can be greatly improved compar…
Imperial College London（帝国理工学院）；Huawei Noah’s Ark Lab（华为诺亚方舟实验室）
Ghosting artifacts, motion blur, and low fidelity in highlight are the main challenges in High Dynamic Range (HDR) imaging from multiple Low Dynamic Range (LDR) images. These issues come from using the medium-exposed image as the reference frame in previous methods. To deal with them, we propose to use the under-exposed image as the reference to avoid these issues. However, the heavy noise in dark regions of the under-exposed image becomes a new problem. Therefore, we propose a joint HDR and denoising pipeline, containing two sub-networks: (i) a pre-denoising network (PreDNNet) to adaptively d…
Lodz University of Technology（罗兹工业大学）；Medical University of Lodz（罗兹医科大学）；Siemens Healthcare GmbH（西门子医疗有限公司）
In this paper, we propose a method for denoising diffusion-weighted images (DWI) of the brain using a convolutional neural network trained on realistic, synthetic MR data. We compare our results to averaging of repeated scans, a widespread method used in clinics to improve signal-to-noise ratio of MR images. To obtain training data for transfer learning, we model, in a data-driven fashion, the effects of echo-planar imaging (EPI): Nyquist ghosting and ramp sampling. We introduce these effects to the digital phantom of brain anatomy (BrainWeb). Instead of simulating pseudo-random noise with a d…
Decomposition of digital signals and images into other basis or dictionaries than time or space domains is a very common approach in signal and image processing and analysis. Such a decomposition is commonly obtained using fixed transforms (e.g., Fourier or wavelet) or dictionaries learned from example databases or from the signal or image itself. In this work, we investigate in detail a new approach of constructing such a signal or image-dependent bases inspired by quantum mechanics tools, i.e., by considering the signal or image as a potential in the discretized Schroedinger equation. To ill…
The current ghost imaging phase reconstruction schemes require either complex optical systems, Fourier transform steps, or iterative algorithms, which may increase the difficulty of system design, cause phase retrieval error or take too much time. To address this problem, we propose a five-step phase-shifting method in which no complex optical systems, Fourier transform steps, or iterative algorithms are needed. With five designed incoherent sources, one can obtain five different corresponding ghost imaging patterns, then the phase information of the object can be calculated from those five sp…
Correspondence imaging can achieve positive-negative ghost images by just conditional averaging of partial patterns, without treating bucket intensities as weights. To explain its imaging mechanism, we develop a probability theory assuming the targets are of gray-scale and the thermal reference speckles obey an arbitrary independent and identical distribution. By both simulation and experiments, we find that the recovered values in each region of the same original gray value conditionally obey a Gaussian distribution. A crosspoint-to-standard-deviation ratio is used as the figure of merit to p…
Enhanced Denoising of Optical Coherence Tomography Images Using Residual U-Net
IIT Bhubaneswar（印度理工学院布巴内斯瓦尔分校）；Aravind Eye Care Systems（阿拉文德眼科医疗系统）；Singapore Eye Research Institute（新加坡眼科研究所）；Duke-NUS Medical School（杜克-新加坡国立大学医学院）；Yong Loo Lin School of Medicine, National University of Singapore（新加坡国立大学杨潞龄医学院）
本研究提出基于 Residual U-Net 架构的增强去噪模型，有效降低 OCT 图像中的散斑噪声并保留组织细节，在 ASOCT 和 PSOCT 两种模态上均显著提升了图像质量指标，助力更精确的临床诊断。
