Multi-spectral quantitative phase imaging (MS-QPI) is a cutting-edge label-free technique to determine the morphological changes, refractive index variations and spectroscopic information of the specimens. The bottleneck to implement this technique to extract quantitative information, is the need of more than two measurements for generating MS-QPI images. We propose a single-shot MS-QPI technique using highly spatially sensitive digital holographic microscope assisted with deep neural network (DNN). Our method first acquires the interferometric datasets corresponding to multiple wavelengths (λ=532, 633 and 808 nm used here). The acquired datasets are used to train generative adversarial network (GAN) to generate multi-spectral quantitative phase maps from a single input interferogram. The network is trained and validated on two different samples, the optical waveguide and a MG63 osteosarcoma cells. Further, validation of the framework is performed by comparing the predicted phase maps with experimentally acquired and processed multi-spectral phase maps. The current MS-QPI+DNN framework can further empower spectroscopic QPI to improve the chemical specificity without complex instrumentation and color-cross talk.
Multispectral imaging plays an important role in many applications from astronomical imaging, earth observation to biomedical imaging. However, the current technologies are complex with multiple alignment-sensitive components, predetermined spatial and spectral parameters by manufactures. Here, we demonstrate a single-shot multispectral imaging technique that gives flexibility to end-users with a very simple optical setup, thank to spatial correlation and spectral decorrelation of speckle patterns. These seemingly random speckle patterns are point spreading functions (PSFs) generated by light …
Conventional approaches for 3D imaging in or through scattering media are usually limited to 2D reconstruction of objects at some discontinuous locations, although the time-consuming iteration, guide-star, or complex system are implemented. How to quickly visualize dynamic 3D objects behind scattering media is still an open issue. Here, by using structured light illumination, we propose a single-shot technique that can quickly acquire continuous 3D surfaces of objects hidden behind the diffuser. The proposed method can realize the 3D imaging of single, multiple, and dynamic targets from the sp…
Based on point spread function (PSF) engineering and astigmatism due to a pair of cylindrical lenses, a novel compressed imaging mechanism is proposed to achieve single-shot incoherent 3D imaging. The speckle-like PSF of the imaging system is sensitive to axial shift, which makes it feasible to reconstruct a 3D image by solving an optimization problem with sparsity constraint. With the experimentally calibrated PSFs, the proposed method is demonstrated by a synthetic 3D point object and real 3D object, and the images in different axial slices can be reconstructed faithfully. Moreover, 3D multi…
Conventional energy-integration black-white X-ray imaging lacks spectral information of X-ray photons. Although X-ray spectra (energy) can be distinguished by photon-counting technique typically with CdZnTe detectors, it is very challenging to be applied to large-area flat-panel X-ray imaging (FPXI). Herein, we design multi-layer stacked scintillators of different X-ray absorption capabilities and scintillation spectrums, in this scenario, the X-ray energy can be discriminated by detecting the emission spectra of each scintillator, therefore the multispectral X-ray imaging can be easily obtain…
White light phase-shifting interference microscopy (WL-PSIM) is a prominent technique for high-resolution quantitative phase imaging (QPI) of industrial and biological specimens. However, multiple interferograms with accurate phase-shifts are essentially required in WL-PSIM for measuring the accurate phase of the object. Here, we present single-shot phase-shifting interferometric techniques for accurate phase measurement using filtered white light phase-shifting interference microscopy (F-WL-PSIM) and deep neural network (DNN). The methods are incorporated by training the DNN to generate 1) fo…
Deep fluorescence imaging in mammalian brain tissues remains challenging due to scattering and optical aberration-induced loss in signal and resolution. Correction of aberrations using adaptive optics (AO) requires their reliable measurement in the tissues. Here, we show that an extended-source Shack-Hartmann wavefront sensor (ESSH) allows quantitative aberration measurements through fixed brain slices with a thickness up to four times their scattering length. We demonstrate in particular that this wavefront measurement method based on image correlation is more robust to scattering compared to…
Detection of phase variations across optically transparent samples is often a difficult task. We propose and demonstrate a compact, lightweight and low cost quantitative phase contrast imager. Light diffracted from a pinhole is incident on a thick object and the modulated light is collected by an image sensor and the intensity pattern is recorded. Two optical configurations namely lens-based and lensless cases are compared. A modified phase-retrieval algorithm is implemented to extract the phase information of the sample at different axial planes from a single camera shot.
The scattering of multispectral incoherent light is a common and unfavorable signal scrambling in natural scenes. However, the blurred light spot due to scattering still holds lots of information remaining to be explored. Former methods failed to recover the polarized hyperspectral information from scattered incoherent light or relied on additional dispersion elements. Here we put forward the transmission matrix (TM) approach for extended objects under incoherent illumination by speculating the unknown TM through experimentally calibrated or digitally emulated ways. Employing a fiber bundle as…
Polarization light microscopes are powerful tools for probing molecular order and orientation in birefringent materials. While a multitude of polarization light microscopy techniques are often used to access steady-state properties of birefringent samples, quantitative measurements of the molecular orientation dynamics on the millisecond time scale have remained a challenge. We propose polarized shearing interference microscopy (PSIM), a single-shot quantitative polarization imaging method, for extracting the retardance and orientation angle of the laser beam transmitting through optically ani…
Inverse designed metasurfaces for multi-wavelength full-Stokes polarisation imaging
The Australian National University（澳大利亚国立大学）；Fraunhofer-Institute for Applied Optics and Precision Engineering IOF（弗劳恩霍夫应用光学和精密工程研究所）；Friedrich Schiller University Jena（耶拿弗里德里希·席勒大学）
A method for quantitative estimation of density in a high-speed flow field is presented, which uses a structured-light beam probe to interrogate the region of interest (ROI). Wavefront distortion suffered by the interrogating beam as it passes through the shock-induced flow field is investigated. Dedicate camera optics is used to measure the cross-sectional intensities of the exiting wavefront at two different planes, simultaneously. A technique is proposed that uses the lateral displacement of the structured light pattern on both the planes to estimate the axial intensity derivative, dI/dz, w…
We present a data-driven approach to compensate for optical aberration in calibration-free quantitative phase imaging (QPI). Unlike existing methods that require additional measurements or a background region to correct aberrations, we exploit deep learning techniques to model the physics of aberration in an imaging system. We demonstrate the generation of a single-shot aberration-corrected field image by using a U-net-based deep neural network that learns a translation between an optical field with aberrations and an aberration-corrected field. The high fidelity of our method is demonstrated …
We propose the inverse design of ultracompact, broadband focusing spectrometers based on adaptive deep diffractive neural networks (a-D$^2$NNs). Specifically, we introduce and characterize two-layer diffractive devices with engineered angular dispersion that focus and steer broadband incident radiation along predefined focal trajectories with desired bandwidth and $5$ nm spectral resolution. Moreover, we systematically study the focusing efficiency of two-layer devices with side length $L=100~μ\mathrm{m}$ and focal length $f=300~\,μ\mathrm{m}$ across the visible spectrum and we demonstrate acc…
High space-bandwidth product with high spatial phase sensitivity is indispensable for a single-shot quantitative phase microscopy (QPM) system. It opens avenue for widespread applications of QPM in the field of biomedical imaging. Temporally low coherence length light sources are generally implemented to achieve high spatial phase sensitivity in QPM at the cost of either reduced temporal resolution or smaller field of view (FOV). On the contrary, high temporal coherence light sources like lasers are capable of exploiting the full FOV of the QPM systems at the expense of less spatial phase sens…
Surface topology measurements of micro- or nanostructures is essential for both scientific and industrial applications. However, high-throughput measurements remain challenging in surface metrology. We present a single-shot full-field surface topography measurement using Kramers-Kronig holographic imaging and spectral multiplexing. Three different intensity images at different incident angles were simultaneously measured with three different colors, from which a quantitative phase image was retrieved using spatial Kramers-Kronig relations. A high-resolution topographic image of the sample was …
A Zero-Shot Deep Image Prior Framework for Denoising and Deconvolution in Fluorescence Microscopy
Wenzhou Key Laboratory of Biomedical Imaging（温州生物医学成像重点实验室）；Zhejiang Key Laboratory of Soft Matter Biomedical Materials（浙江软物质生物医学材料重点实验室）；Wenzhou Institute, University of Chinese Academy of Sciences（中国科学院大学温州研究院）；Postgraduate Training Base Alliance of Wenzhou Medical University（温州医学院研究生联合培养基地联盟）
We address the problem of reconstructing phase-shifting objects from their single shot in-line holograms. We show that a phase-shifting object cannot be reliably recovered from its in-line hologram by non-iterative reconstruction routines, and that an iterative reconstruction should be applied. We demonstrate examples of simulated in-line holograms of objects with the following properties: purely absorbing, both absorbing and phase shifting, and strong phase-shifting. We investigate the effects of noise and interference contrast in holograms on the reconstruction results and discuss details of…
Nanoscale phase-control is one of the most powerful approaches to specifically tailor electrical fields in modern nanophotonics. Especially the precise sub-wavelength assembly of many individual nano-building-blocks has given rise to exciting new materials as diverse as metamaterials, for miniaturizing optics, or 3D assembled plasmonic structures for biosensing applications. Despite its fundamental importance, the phase-response of individual nanostructures is experimentally extremely challenging to visualize. Here, we address this shortcoming and measure the quantitative scattering phase of d…
Diagnostics capable of interrogating dynamics in harsh environments such as plasma have remained essentially unchanged in recent decades. Developments in advanced microscopy techniques will improve our understanding of the physics involved in these events. Recently developed single-shot ptychography (SSP) provides a pathway towards sophisticated plasma metrologies. Here we introduce wavelength-multiplexed single-shot ptychography (WM-SSP), which allows for hyperspectral, spatially and temporally resolved phase and amplitude contrast imaging. Furthermore, we introduce a novel probe constraint c…
Institute for Biological and Medical Imaging (IBMI), Helmholtz Zentrum München（亥姆霍兹慕尼黑中心生物与医学成像研究所）；Department of Radiation Oncology, Klinikum rechts der Isar, Technische Universität München（慕尼黑工业大学伊萨尔河畔医院放射肿瘤科）；Chair for Biological Imaging, Technische Universität München（慕尼黑工业大学生物成像教席）；CCG – Innate immunity in Tumor Biology, Helmholtz Zentrum München（亥姆霍兹慕尼黑中心肿瘤生物学先天免疫合作研究组）
Light propagating in tissue attains a spectrum that varies with location due to wavelength-dependent fluence attenuation by tissue optical properties, an effect that causes spectral corruption. Predictions of the spectral variations of light fluence in tissue are challenging since the spatial distribution of optical properties in tissue cannot be resolved in high resolution or with high accuracy by current methods. Spectral corruption has fundamentally limited the quantification accuracy of optical and optoacoustic methods and impeded the long sought-after goal of imaging blood oxygen saturati…
