Under weak illumination, tracking and imaging moving object turns out to be hard. By spatially collecting the signal, single pixel imaging schemes promise the capability of image reconstruction from low photon flux. However, due to the requirement on large number of samplings, how to clearly image moving objects is an essential problem for such schemes. Here we present a principle of single pixel tracking and imaging method. Velocity vector of the object is obtained from temporal correlation of the bucket signals in a typical computational ghost imaging system. Then the illumination beam is steered accordingly. Taking the velocity into account, both trajectory and clear image of the object are achieved during its evolution. Since tracking is achieved with bucket signals independently, this scheme is valid for capturing moving object as fast as its displacement within the interval of every sampling keeps larger than the resolution of the optical system. Experimentally, our method works well with the average number of detected photons down to 1.88 photons/speckle.
In previous single-pixel imaging systems, the light source was generally idle with respect to time. Here, we propose a novel image fusion and visible watermarking scheme based on Fourier single-pixel imaging (FSPI) with a multiplexed time-varying (TV) signal, which is generated by the watermark pattern hidden in the light source. We call this scheme as TV-FSPI. With TV-FSPI, we can realize high-quality visible image watermarking, encrypted image watermarking and full-color visible image watermarking. We also discuss the extension to invisible watermarking based on TV-FSPI. Furthermore, we don'…
Quantitative phase imaging (QPI) is important in many applications such as microscopy and crystallography. To quantitatively reveal phase information, people could either employ interference to map phase distribution into intensity fringes, or analyze intensity-only diffraction patterns through phase retrieval algorithms. Traditionally, both of these two ways use pixelated detectors. In this work, a novel QPI scheme is reported inspired by single-pixel camera (SPC), which adopts the principle of SPC that retrieves images through structured illumination and corresponding single-pixel signals. P…
Optical diffraction tomography is an indispensable tool for studying objects in three-dimensions due to its ability to accurately reconstruct scattering objects. Until now this technique has been limited to coherent light because spatial phase information is required to solve the inverse scattering problem. We introduce a method that extends optical diffraction tomography to imaging spatially incoherent contrast mechanisms such as fluorescent emission. Our strategy mimics the coherent scattering process with two spatially coherent illumination beams. The interferometric illumination pattern en…
A generic computational imaging setup is considered which assumes sequential illumination of a semi-transparent object by an arbitrary set of structured illumination patterns. For each incident illumination pattern, all transmitted light is collected by a photon-counting bucket (single-pixel) detector. The transmission coefficients measured in this way are then used to reconstruct the spatial distribution of the object's projected transmission. It is demonstrated that the squared spatial resolution of such a setup is usually equal to the ratio of the image area to the number of linearly indepe…
Optical imaging through scattering media is a long-standing challenge. Although many approaches have been developed to focus light or image objects through scattering media, they are either invasive, restricted to stationary or slowly-moving media, or require high-resolution cameras and complex algorithms to retrieve the images. Here we introduce a computational imaging technique that can overcome these restrictions by exploiting spatial-temporal encoded patterns (STEP). We present non-invasive imaging through scattering media with a single-pixel photodetector. We show that the method is insen…
We report a line scanning imaging modality of compressive Raman technology with spatial frequency modulated illumination using a single pixel detector. We demonstrate the imaging and classification of three different chemical species at line scan rates of 40 Hz.
Localization of single fluorescent molecules is key for physicochemical and biophysical measurements such as single-molecule tracking and super-resolution imaging by single-molecule localization microscopy (SMLM). Recently a series of methods have been developed in which the localization precision is enhanced by interrogating the molecular position with a sequence of spatially modulated patterns of light. Among them, the MINFLUX technique outstands for achieving a ~10-fold improvement compared to wide-field camera-based single-molecule localization, reaching ~1-2 nm localization precision at m…
Silicon photodiode based CMOS sensors with backside-illumination for 300 to 1000 nm wavelength range were studied. We showed that a single hole in the photodiode increases the optical efficiency of the pixel. In near-infrared wavelengths, the enhancement allows 70% absorption in a 3 microns thick Si. It is 4x better than for the flat pixel. We compared different shapes and sizes of single holes and holes arrays. We have shown that a certain size and shape in single holes pronounce better optical efficiency enhancement. The crosstalk was successfully reduced with trenches between pixels. We opt…
Structured-light three-dimensional (3D) imaging can achieve 3D shape of a stationary object via one or more pixelated array cameras with phase-shifting illumination. In order to extend 3D imaging to moving scenarios, we propose a 3D imaging method with double projection of a single-frame modulated light pattern and a sampling pattern. It can continuously image the moving 3D scene by making multi-pixel detector axial flat brush scan along the motion axis. Utilizing spatial multiplexing for multiple single-pixel imaging, each single-pixel does not need to keep staring at some part of the object,…
In high-frequency photoacoustic imaging with uniform illumination, homogeneous photo-absorbing structures may be invisible because of their large size or limited-view issues. Here we show that, by exploiting dynamic speckle illumination, it is possible to reveal features which are normally invisible with a photoacoustic system comprised of a 20MHz linear ultrasound array. We demonstrate imaging of a 5 mm diameter absorbing cylinder and a 30 micrometer black thread arranged in a complex shape. The hidden structures are directly retrieved from photoacoustic images recorded for different random s…
We present a compact, diffuser-assisted, single-pixel computational camera. A rotating ground glass diffuser is adopted, in preference to a commonly used digital micro-mirror device (DMD), to encode a two-dimensional (2D) image into single-pixel signals. We retrieve images with an 8.8% sampling ratio after the calibration of the pseudo-random pattern of the diffuser under incoherent illumination. Furthermore, we demonstrate hyperspectral imaging with line array detection by adding a diffraction grating. The implementation results in a cost-effective single-pixel camera for high-dimensional ima…
We have performed off axis heterodyne holography with very weak illumination by recording holograms of the object with and without object illumination in the same acquisition run. We have experimentally studied, how the reconstructed image signal (with illumination) and noise background (without) scale with the holographic acquisition and reconstruction parameters that are the number of frames, and the number of pixels of the reconstruction spatial filter. The first parameter is related to the frequency bandwidth of detection in time, the second one to the bandwidth in space. The signal to bac…
We propose and demonstrate a computational imaging technique that uses structured illumination based on a two-dimensional discrete cosine transform to perform imaging with a single-pixel detector. A scene is illuminated by a projector with two sets of orthogonal patterns, then by applying an inverse cosine transform to the spectra obtained from the single-pixel detector a full-color image is retrieved. This technique can retrieve an image from sub-Nyquist measurements, and the background noise is easily canceled to give excellent image quality. Moreover, the experimental setup is very simple.
This work presents the development of a flexible microscopic chemical imaging platform for cultural heritage that utilizes wavelength-tunable oblique illumination from a point source to obtain per-pixel reflectance spectra in the VIS-NIR range. The microscope light source can be adjusted on two axes allowing for a hemisphere of possible illumination directions. The synthesis of multiple illumination angles allows for the calculation of surface normal vectors, similar to phase gradients, and axial optical sectioning. The extraction of spectral reflectance images with high spatial resolutions fr…
Near-UV Single-Pixel Imaging with All-Inorganic Lead-Free Perovskite
University of Technology Sydney（悉尼科技大学）；ARC center of Excellence for Transformative Meta-Optical Systems（变革性超光学系统卓越研究中心）；University of New South Wales（新南威尔士大学）
We present a quantitative comparison between the high-pressure fuel spray images obtained experimentally using classical imaging with coherent and incoherent ultrafast illuminations recorded using a compatible CMOS camera. The ultrafast, incoherent illumination source was extracted from the supercontinuum generated by tightly focusing the femtosecond laser pulses in water. The average velocity maps computed using time-correlated image-pairs and spray edge complexity computed using the average curvature scale space maps are compared for the spray images obtained with the two illumination techni…
A simple and robust experiment demonstrating computational ghost imaging with structured illumination and a single-pixel detector has been performed. Our experimental setup utilizes a general computer for generating pseudo-randomly patterns on the liquid crystal display screen to illuminate a partially-transmissive object. With an incoherent light source, this object is imaged. The effects of light source, light path, and the number of measurements on the reconstruction quality of the object are discussed both theoretically and experimentally. The realization of computational ghost imaging wit…
Computational ghost imaging is a robust and compact system that has drawn wide attentions over the last two decades. Multispectral imaging possesses spatial and spectral resolving abilities, is very useful for surveying scenes and extracting detailed information. Existing multispectral imagers mostly utilize narrow band filters or dispersive optical devices to separate lights of different wavelengths, and then use multiple bucket detectors or an array detector to record them separately. Here, we propose a novel multispectral ghost imaging method that uses one single bucket detector with multip…
Single-pixel imaging (SPI) is a novel optical imaging technique by replacing the pixelated sensor array in a conventional camera with a single-pixel detector. In previous works, SPI is usually used for capturing object images or performing image processing tasks. In this work, we propose a SPI scheme for processing other types of data in addition to images. An Ising machine model is implemented optically with SPI for solving combinational optimization problems including number partition and graph maximum cut. Simulated and experimental results show that our proposed scheme can optimize the Ham…
Time-of-flight three dimensional imaging is an important tool for many applications, such as object recognition and remote sensing. Unlike conventional imaging approach using pixelated detector array, single-pixel imaging based on projected patterns, such as Hadamard patterns, utilises an alternative strategy to acquire information with sampling basis. Here we show a modified single-pixel camera using a pulsed illumination source and a high-speed photodiode, capable of reconstructing 128x128 pixel resolution 3D scenes to an accuracy of ~3 mm at a range of ~5 m. Furthermore, we demonstrate cont…
Effective and accurate in-vivo diagnosis of retinal pathologies requires high performance imaging devices, combining a large field of view and the ability to discriminate the ballistic signal from the diffuse background in order to provide a highly contrasted image of the retinal structures. Here, we have implemented the Partial-Field Illumination Ophthalmoscope, a patterned illumination modality, integrated on a high pixel rate adaptive optics full-field microscope. This non-invasive technique enables us to mitigate the low signal-to-noise ratio, intrinsic of full-field ophthalmoscopes, by pa…
Single-photon-avalanche diode (SPAD) arrays are essential tools in biophotonics, optical ranging and sensing and quantum optics. However, their small number of pixels, low quantum efficiency and small fill factor have so far hindered their use for practical imaging applications. Here, we demonstrate full-field entangled photon pair correlation imaging using a 100-kpixels SPAD camera. By measuring photon coincidences between more than 500 million pairs of positions, we retrieve the full point spread function of the imaging system and subsequently high-resolution images of target objects illumin…
Single particle tracking is essential in many branches of science and technology, from the measurement of biomolecular forces to the study of colloidal crystals. Standard current methods rely on algorithmic approaches: by fine-tuning several user-defined parameters, these methods can be highly successful at tracking a well-defined kind of particle under low-noise conditions with constant and homogenous illumination. Here, we introduce an alternative data-driven approach based on a convolutional neural network, which we name DeepTrack. We show that DeepTrack outperforms algorithmic approaches, …
Tsinghua National Laboratory for Information Science and Technology (TNList), Department of Electronic Engineering, Tsinghua University（清华大学信息科学与技术国家实验室，电子工程系，清华大学）；Department of Biomedical Engineering, School of Medicine, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Tsinghua University（清华大学生物医学工程系，医学院，传染病诊治协同创新中心，清华大学）
Single-pixel cameras based on the concepts of compressed sensing (CS) leverage the inherent structure of images to retrieve them with far fewer measurements and operate efficiently over a significantly broader spectral range than conventional silicon-based cameras. Recently, photonic time-stretch (PTS) technique facilitates the emergence of high-speed single-pixel cameras. A significant breakthrough in imaging speed of single-pixel cameras enables observation of fast dynamic phenomena. However, according to CS theory, image reconstruction is an iterative process that consumes enormous amounts …
