Comparative analysis of imaging configurations and objectives for Fourier microscopy
Jonathan A. Kurvits, Mingming Jiang, Rashid Zia
备注：
For related figshare fileset with complete Zemax models of microscope objectives, tube lenses, and Fourier imaging configurations, see Ref. [41] (available at http://dx.doi.org/10.6084/m9.figshare.1481270)
Fourier microscopy is becoming an increasingly important tool for the analysis of optical nanostructures and quantum emitters. However, achieving quantitative Fourier space measurements requires a thorough understanding of the impact of aberrations introduced by optical microscopes, which have been optimized for conventional real-space imaging. Here, we present a detailed framework for analyzing the performance of microscope objectives for several common Fourier imaging configurations. To this end, we model objectives from Nikon, Olympus, and Zeiss using parameters that were inferred from patent literature and confirmed, where possible, by physical disassembly. We then examine the aberrations most relevant to Fourier microscopy, including the alignment tolerances of apodization factors for different objective classes, the effect of magnification on the modulation transfer function, and vignetting-induced reductions of the effective numerical aperture for wide-field measurements. Based on this analysis, we identify an optimal objective class and imaging configuration for Fourier microscopy. In addition, as a resource for future studies, the Zemax files for the objectives and setups used in this analysis have been made publicly available.
In this letter, the leakage radiation microscopy (LRM) is extended into characterization of planar waveguide modes (WMs) rather than surface plasmon polaritons (SPPs) taking advantages of the coupling between WMs and fluorescence emission. Propagation constants of different WMs allowed in the same planar waveguide can be simultaneously and rapidly derived from the Fourier plane image of fluorescence based LRM. Numerical simulations are also carried out to calculate propagation constants of these modes, which are consistent with experimental results. Our experiments provide a simple but high ef…
We demonstrate a simple scheme for high-resolution imaging of nanoplasmonic structures that basically removes most of the resolution limiting allowed light usually transmitted to the far field. This is achieved by implementing a Fourier lens in a near-field scanning optical microscope (NSOM) operating in the leakage-radiation microscopy (LRM) mode. The method consists of reconstructing optical images solely from the plasmonic `forbidden' light collected in the Fourier space. It is demonstrated by using a point-like nanodiamond-based tip that illuminates a thin gold film patterned with a sub-wa…
In this article, we report an imaging method, termed Fourier ptychographic microscopy (FPM), which iteratively stitches together a number of variably illuminated, low-resolution intensity images in Fourier space to produce a wide-field, high-resolution complex sample image. By adopting a wavefront correction strategy, the FPM method can also correct for aberrations and digitally extend a microscope's depth-of-focus beyond the physical limitations of its optics. As a demonstration, we built a microscope prototype with a resolution of 0.78 um, a field-of-view of ~120 mm2, and a resolution-invari…
Fourier ptychographic microscopy (FPM) is a recently developed imaging modality that uses angularly varying illumination to extend a system performance beyond the limit defined by its optical elements. The FPM technique applies a novel phase retrieval procedure to achieve both resolution enhancement and complex image recovery. In this letter, we compare FPM data to both theoretical prediction and phase-shifting digital holography measurement to show that its acquired phase maps are quantitative and artifact-free. We additionally explore the relationship between the achievable spatial and optic…
Photothermal Fourier-plane Phase Synchronization for Interferometric Scattering Microscopy
Huazhong University of Science and Technology（华中科技大学）；Wuhan National Laboratory for Optoelectronics（武汉光电国家研究中心）；Institute of Photonics and Electronics of the Czech Academy of Sciences（捷克科学院光子学与电子学研究所）
While numerous optical methods exist to probe the dynamics of biological or complex fluid samples, in recent years digital Fourier microscopy techniques, like differential dynamic microscopy, have emerged as ways to efficiently combine elements of imaging and scattering methods. Here, we demonstrate, through experiments and simulations, how point-spread function engineering can be used to extend the reach of differential dynamic microscopy.
Controlling the dispersion and directionality of the emission of nanosources is one of the major goals of nanophotonics research. This control will allow the development of highly efficient nanosources even at the single photon level. One of the ways to achieve this goal is to couple the emission to Bloch modes of periodic structures. Here, we present the first measurements of the directional emission from nanowire photonic crystals by using Fourier microscopy. With this technique we efficiently collect and resolve the directional emission of nanowires within the numerical aperture of a micros…
Following the recent developement of Fourier ptychographic microscopy (FPM) in the visible range by Zheng et al. (2013), we propose an adaptation for hard x-rays. FPM employs ptychographic reconstruction to merge a series of low-resolution, wide field of view images into a high-resolution image. In the x-ray range this opens the possibility to overcome the limited numerical aperture of existing x-ray lenses. Furthermore, digital wave front correction (DWC) may be used to charaterize and correct lens imperfections. Given the diffraction limit achievable with x-ray lenses (below 100 nm), x-ray F…
A Residual-Subspace Constraint Framework for Fourier Ptychographic Microscopy
School of Physics & State Key Laboratory of Optoelectronic Materials and Technologies, Sun Yat-sen University（中山大学物理学院与光电材料与技术国家重点实验室）；College of Information Science and Electronic Engineering, Zhejiang University（浙江大学信息与电子工程学院）
Fourier ptychographic microscopy (FPM) is a computational imaging technique that overcomes the physical space-bandwidth product (SBP) limit of a conventional microscope by applying angular diversity illuminations. In the usual model of FPM, the microscopic system is approximated by being taken as space-invariant with transfer function determined by a complex pupil function of the objective. However, in real experimental conditions, several unexpected "semi-bright and semi-dark" images with strong vignetting effect can be easily observed when the sample is illuminated by the LED within the "tra…
Fourier light-field microscopy (FLFM) uses a micro-lens array (MLA) to segment the Fourier Plane of the microscopic objective lens to generate multiple two-dimensional perspective views, thereby reconstructing the three-dimensional(3D) structure of the sample using 3D deconvolution calculation without scanning. However, the resolution of FLFM is still limited by diffraction, and furthermore, dependent on the aperture division. In order to improve its resolution, a Super-resolution optical fluctuation Fourier light field microscopy (SOFFLFM) was proposed here, in which the Sofi method with abil…
We report a new experimental technique for quantifying the angular distribution of light scattered by single plasmonic and metamaterial nanoscatterers, based on Fourier microscopy in a dark field confocal set up. This new set up is a necessary tool for quantifying the scattering properties of single plasmonic and meatamaterial building blocks, as well as small coupled clusters of such building blocks, which are expected to be the main ingredients of nano-antennas, light harvesting structures and transformation optics. We present a set of measurements on Au nanowires of different lengths and sh…
We demonstrate a new computational illumination technique that achieves large space-bandwidth-time product, for quantitative phase imaging of unstained live samples in vitro. Microscope lenses can have either large field of view (FOV) or high resolution, not both. Fourier ptychographic microscopy (FPM) is a new computational imaging technique that circumvents this limit by fusing information from multiple images taken with different illumination angles. The result is a gigapixel-scale image having both wide FOV and high resolution, i.e. large space-bandwidth product (SBP). FPM has enormous pot…
We report a computational 3D microscopy technique, termed Fourier ptychographic diffraction tomography (FPDT), that iteratively stitches together numerous variably illuminated, low-resolution images acquired with a low-numerical aperture (NA) objective in 3D Fourier space to create a wide field-of-view (FOV), high-resolution, depth-resolved complex refractive index (RI) image across large volumes. Unlike conventional optical diffraction tomography (ODT) approaches that rely on controlled bright-field illumination, holographic phase measurement, and high-NA objective detection, FPDT employs tom…
Fourier ptychography microscopy (FPM) is a new computational imaging technique that can provide gigapixel images with both high resolution and a wide field of view (FOV). However, time consuming of the data-acquisition process is a critical issue. In this paper, we make an analysis on the FPM imaging system with half number of the captured images. Based on the image analysis of the conventional FPM system, we then compare the reconstructed images with different number of captured data. Simulation and experiment results show that the reconstructed image with half number captured data do not sho…
Confining light to sharp metal tips has become a versatile technique to study optical and electronic properties far below the diffraction limit. Particularly near-field microscopy in the mid-infrared spectral range has found a variety of applications in probing nanostructures and their dynamics. Yet, the ongoing quest for ultimately high spatial resolution down to the single-nanometer regime and quantitative three-dimensional nano-tomography depends vitally on a precise knowledge of the spatial distribution of the near fields emerging from the probe. Here, we perform finite element simulations…
We report a novel microscopy platform, termed Multi-Aperture Fourier ptychographic microscopy (MA-FPM), capable of realizing gigapixel complex field images with large data acquisition bandwidths - in gigapixels per second. MA-FPM is a synthetic aperture technique- an array of objectives together with tilt-shift illumination are used to synthesize high-resolution, wide field-of-view images. Here, the phase is recovered using Fourier ptychography (FP) algorithms, unlike conventional optical synthetic aperture techniques where holographic measurements are used. The parallel data-acquisition capab…
Light field microscopy (LFM) uses a microlens array (MLA) near the sensor plane of a microscope to achieve single-shot 3D imaging of a sample without any moving parts. Unfortunately, the 3D capability of LFM comes with a significant loss of lateral resolution at the focal plane. Placing the MLA near the pupil plane of the microscope, instead of the image plane, can mitigate the artifacts and provide an efficient forward model, at the expense of field-of-view (FOV). Here, we demonstrate improved resolution across a large volume with Fourier DiffuserScope, which uses a diffuser in the pupil plan…
Recording of transient absorption microscopy images requires fast detection of minute optical density changes, which is typically achieved with high-repetition-rate laser sources and lock-in detection. Here, we present a highly flexible and cost-efficient detection scheme based on a conventional photodiode and an USB oscilloscope with MHz bandwidth, that deviates from the commonly used lock-in scheme and achieves benchmark sensitivity. Our scheme combines shot-to-shot evaluation of pump-probe and probe-only measurements, a home-built photodetector circuit optimized for low pulse energies apply…
Fourier ptychographic (FP) microscope is a coherent imaging method that can synthesize an image with a higher bandwidth using multiple low-bandwidth images captured at different spatial frequency regions. The method's demand for multiple images drives the need for a brighter illumination scheme and a high-frame-rate camera for a faster acquisition. We report the use of a guided laser beam as an illumination source for an FP microscope. It uses a mirror array and a 2-dimensional scanning Galvo mirror system to provide a sample with plane-wave illuminations at diverse incidence angles. The use o…
Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences（中国科学院上海光学精密机械研究所）；University of Chinese Academy of Sciences（中国科学院大学）；Mechanobiology Institute, National University of Singapore（新加坡国立大学机械生物学研究所）；Seoul National University（首尔大学）；The University of Hong Kong（香港大学）
Fourier ptychographi cmicroscopy(FPM) is a newly developed computational imaging technique that can provide gigapixel images with both high resolution (HR) and wide field of view (FOV). However, the positional misalignment of the LED array induces a degradation of the reconstruction, especially in the regions away from the optical axis. In this paper, we propose a robust and fast method to correct the LED misalignment of FPM, termed as misalignment correction for FPM (mcFPM). Although different regions in the FOV have different sensitivity to the LED misalignment, the experimental results show…
Fourier ptychographic microscopy (FPM) is a recently proposed quantitative phase imaging technique with high resolution and wide field-of-view (FOV). In current FPM imaging platforms, systematic error sources come from the aberrations, LED intensity fluctuation, parameter imperfections and noise, which will severely corrupt the reconstruction results with artifacts. Although these problems have been researched and some special methods have been proposed respectively, there is no method to solve all of them. However, the systematic error is a mixture of various sources in the real situation. It…
Automated label-free quantitative imaging of biological samples can greatly benefit high throughput diseases diagnosis. Digital holographic microscopy (DHM) is a powerful quantitative label-free imaging tool that retrieves structural details of cellular samples non-invasively. In off-axis DHM, a proper spatial filtering window in Fourier space is crucial to the quality of reconstructed phase image. Here we describe a region-recognition approach that combines shape recognition with an iterative thresholding to extracts the optimal shape of frequency components. The region recognition technique …
We collaborated with Amgen and spent five years in designing and fabricating next generation multi-well plate imagers based on Fourier ptychographic microscopy (FPM). A 6-well imager (Emsight) and a low-cost parallel microscopic system (96 Eyes) based on parallel FPM were reported in our previous work. However, the effect of liquid meniscus on the image quality is much stronger than anticipated, introducing obvious wavevector misalignment and additional image aberration. To this end, an adaptive wavevector correction (AWC-FPM) algorithm and a pupil recovery improvement strategy are presented t…
Fourier ptychographic microscopy (FPM) is a recently developed computational imaging technique for wide-field, high-resolution microscopy with a high space-bandwidth product. It integrates the concepts of synthetic aperture and phase retrieval to surpass the resolution limit imposed by the employed objective lens. In the FPM framework, the position of each sub-spectrum needs to be accurately known to ensure the success of the phase retrieval process. Different from the conventional methods with mechanical adjustment or data-driven optimization strategies, here we report a physics-based defocus…
Fourier ptychographic microscopy (FPM) can achieve quantitative phase imaging with a large space-bandwidth product by synthesizing a set of low-resolution intensity images captured under angularly varying illuminations. Determining accurate illumination angles is critical because the consistency between actual systematic parameters and those used in the recovery algorithm is essential for high-quality imaging. This paper presents a full-pose-parameter and physics-based method for calibrating illumination angles. Using a physics-based model constructed with general knowledge of the employed mic…
Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences（中国科学院西安光学精密机械研究所）；University of Chinese Academy of Sciences（中国科学院大学）
Fourier ptychographic microscopy (FPM) is a recently proposed computational imaging technique with both high resolution and wide field-of-view. In current FP experimental setup, the dark-field images with high-angle illuminations are easily submerged by stray light and background noise due to the low signal-to-noise ratio, thus significantly degrading the reconstruction quality and also imposing a major restriction on the synthetic numerical aperture (NA) of the FP approach. To this end, an overall and systematic data preprocessing scheme for noise removal from FP's raw dataset is provided, wh…
Correlation plenoptic imaging (CPI) is a scanning-free diffraction-limited 3D optical imaging technique exploiting the peculiar properties of correlated light sources. CPI has been further extended to samples of interest to microscopy, such as fluorescent or scattering objects, in a modified architecture named correlation light-field microscopy (CLM). Interestingly, experiments have shown that the noise performances of CLM are significantly improved over the original CPI scheme, leading to better images and faster acquisition. In this work, we provide a theoretical foundation to such advantage…
Fourier ptychographic microscopy (FPM) is a computational imaging technique with both high resolution and large field-of-view. However, the effective numerical aperture (NA) achievable with a typical LED panel is ambiguous and usually relies on the repeated tests of different illumination NAs. The imaging quality of each raw image usually depends on the visual assessments, which is subjective and inaccurate especially for those dark field images. Moreover, the acquisition process is really time-consuming.In this paper, we propose a SNR-based adaptive acquisition method for quantitative evaluat…
Nonlinear optical microscopy allows rapid high-resolution microscopy with image contrast generated from intrinsic properties of the sample. Established modalities such as multiphoton excited fluorescence and second/third-harmonic generation can be combined with other nonlinear techniques, such as coherent Raman spectroscopy which typically allow chemical imaging of a single resonant vibrational mode of a sample. Here, we utilize a single ultrafast laser source to obtain broadband coherent Raman spectra on a microscope, together with other nonlinear microscopy approaches on the same instrument.…
We have extended Laser Doppler holographic microscopy to transmission geometry. The technique is validated with living fish embryos imaged by a modified upright bio-microcope. By varying the frequency of the holographic reference beam, and the combination of frames used to calculate the hologram, multimodal imaging has been performed. Doppler images of the blood vessels for different Doppler shifts, images where the flow direction is coded in RGB colors or movies showing blood cells individual motion have been obtained as well. The ability to select the Fourier space zone that is used to calcu…
We present a joint experimental and theoretical study of the driven Su-Schrieffer-Heeger model implemented by arrays of evanescently coupled plasmonic waveguides. Floquet theory predicts that this system hosts for suitable driving frequencies a topologically protected edge state that has no counterpart in static systems, the so-called anomalous Floquet topological $π$-mode. By using real- and Fourier-space leakage radiation microscopy in combination with edge- and bulk excitation, we unequivocally identify the anomalous Floquet topological $π$-mode and study its frequency dependence.
Intensity, wavevector, phase, and polarization are the most important parameters of any light beam. Understanding the wavevector distribution has emerged as a very important problem in recent days, especially at nanoscale. It provides unique information about the light-matter interaction. Back focal plane or Fourier plane imaging and spectroscopy techniques help to measure wavevector distribution not only from single molecules and single nanostructures but also from metasurfaces and metamaterials. This review provides a birds-eye view on the technique of back focal imaging and spectroscopy, di…
The Catholic University of America（美国天主教大学）；Boston University（波士顿大学）
Convolutional neural networks (CNNs) have gained tremendous success in solving complex inverse problems. The aim of this work is to develop a novel CNN framework to reconstruct video sequence of dynamic live cells captured using a computational microscopy technique, Fourier ptychographic microscopy (FPM). The unique feature of the FPM is its capability to reconstruct images with both wide field-of-view (FOV) and high resolution, i.e. a large space-bandwidth-product (SBP), by taking a series of low resolution intensity images. For live cell imaging, a single FPM frame contains thousands of cell…
Fourier ptychography microscopy (FPM), sharing its roots with synthetic aperture technique and phase retrieval method, is a recently developed computational microscopic super-resolution technique. By turning on the light-emitting diode (LED) elements sequentially and acquiring the corresponding images that contain different spatial frequencies, FPM can achieve a wide field-of-view (FOV), high-spatial-resolution imaging, and phase recovery simultaneously. Conventional FPM assumes that the sample is sufficiently thin and strictly in focus. Nevertheless, even for a relatively thin sample, the non…
Measurement of Photocarrier Mean Free Path via Speckled Laser Pump -- Transient Fourier Microscopy Probe
Center for Neutron Science and Technology, Guangdong Provincial Key Laboratory of Magnetoelectric Physics and Devices, School of Physics, Sun Yat-sen University（中山大学物理学院中子科学与技术中心、广东省铁电物理与器件重点实验室）；State Key Laboratory of Optoelectronic Materials and Technologies, School of Physics, Sun Yat-sen University（中山大学物理学院光电材料与技术国家重点实验室）
High Space-bandwidth Product Label-free Examination of iPSC-derived Brain Organoids via Fourier Ptychographic Microscopy
Department of Physics and Technology, UiT The Arctic University of Norway（挪威北极大学物理与技术系）；Division of Clinical Microbiology, Department of Laboratory Medicine, Karolinska Institutet（卡罗林斯卡学院实验室医学系临床微生物学部）
Raman sensing and Raman microscopy are amongst the most specific optical technologies to identify the chemical compounds of unknown samples, and to enable label-free biomedical imaging with molecular contrast. However, the high cost and complexity, low speed, and incomplete spectral information provided by current technology are major challenges preventing more widespread application of Raman systems. To overcome these limitations, we developed a new method for stimulated Raman spectroscopy and Raman imaging using continuous wave (CW), rapidly wavelength swept lasers. Our all-fiber, time-encod…
Tsinghua National Laboratory for Information Science and Technology (TNList), Department of Electronic Engineering, Tsinghua University（清华大学信息科学与技术国家实验室，电子工程系，清华大学）；Department of Biomedical Engineering, School of Medicine, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Tsinghua University（清华大学生物医学工程系，医学院，传染病诊治协同创新中心，清华大学）
Single-pixel cameras based on the concepts of compressed sensing (CS) leverage the inherent structure of images to retrieve them with far fewer measurements and operate efficiently over a significantly broader spectral range than conventional silicon-based cameras. Recently, photonic time-stretch (PTS) technique facilitates the emergence of high-speed single-pixel cameras. A significant breakthrough in imaging speed of single-pixel cameras enables observation of fast dynamic phenomena. However, according to CS theory, image reconstruction is an iterative process that consumes enormous amounts …
Light microscopy enables multifunctional imaging of biological specimens at unprecedented depths and resolutions. However, the performance of all optical methods degrades with the imaging depth due to sample-induced aberrations. Methods of adaptive optics (AO) are aimed at pre-compensation of these distortions but state-of-the-art adaptive optics still provides a limited field of view and imaging depth. Here I propose a new approach to overcome these limitations: Fourier image plane conjugate AO. Two possible experimental designs of the new approach are investigated and an accurate comparison …
