Video-rate super-resolution imaging through biological tissue can visualize and track biomolecule interplays and transportations inside cellular organisms. Structured illumination microscopy allows for wide-field super resolution observation of biological samples but is limited by the strong absorption and scattering of light by biological tissues, which degrades its imaging resolution. Here we report a photon upconversion scheme using lanthanide-doped nanoparticles for wide-field super-resolution imaging through the biological transparent window, featured by near-infrared and low-irradiance nonlinear structured illumination. We demonstrate that the 976 nm excitation and 800 nm up-converted emission can mitigate the aberration. We found that the nonlinear response of upconversion emissions from single nanoparticles can effectively generate the required high spatial frequency components in Fourier domain. These strategies lead to a new modality in microscopy with a resolution of 130 nm, 1/7th of the excitation wavelength, and a frame rate of 1 fps.
Lanthanide-based upconversion nanoparticles (UCNPs) generally require high power laser excitation. Here we report wide-field upconversion microscopy at single-nanoparticle sensitivity using incoherent excitation of a 970-nm light-emitting diode (LED). We show that due to its broad emission spectrum, LED excitation is about 3 times less effective for UCNPs and generates high background compared to laser illumination. To counter this, we use time-gated luminescence detection to eliminate the residual background from the LED source, so that individual UCNPs with high sensitizer (Yb3+) doping and …
We demonstrate effective background-free continuous wave nonlinear optical excitation of molecules that are sandwiched between asymmetrically constructed plasmonic gold nanoparticle clusters. We observe that near infrared photons are converted to visible photons through efficient plasmonic second harmonic generation. Our theoretical model and simulations demonstrate that Fano resonances may be responsible for being able to observe nonlinear conversion using a continuous wave light source. We show that nonlinearity enhancement of plasmonic nanostructures via coupled quantum mechanical oscillato…
The emerging optical multiplexing within nanoscale shows super-capacity in encoding information by using the time-domain fingerprints from uniform nanoparticles. However, the optical diffraction limit compromises the decoding throughput and accuracy of the nanoparticles during wide-field imaging. This, in turn, challenges the quality of nanoparticles to afford the modulated excitation condition, and further to retain the multiplexed optical fingerprints for super-resolution multiplexing. Here we report a tailor-made time-domain super-resolution method with the lifetime-engineered upconversion …
Upconversion nanoparticles (UCNPs) exhibit unique optical properties such as photo-emission stability, large anti-Stokes shift, and long excited-state lifetimes, allowing significant advances in a broad range of applications from biomedical sensing to super-resolution microscopy. In recent years, progress on nanoparticle synthesis led to the development of many strategies for enhancing their upconversion luminescence, focused in particular on heavy doping of lanthanide ions and core-shell structures. In this article, we investigate the non-linear emission properties of fully Yb-based core-shel…
Single-beam super-resolution microscopy, also known as superlinear microscopy, exploits the nonlinear response of fluorescent probes in confocal microscopy. The technique requires no complex purpose-built system, light field modulation, or beam shaping. Here, we present a strategy to enhance spatial resolution of superlinear microscopy by modulating excitation intensity during image acquisition. This modulation induces dynamic optical nonlinearity in upconversion nanoparticles (UCNPs), resulting in variations of higher spatial-frequency information in the obtained images. The high-order inform…
We demonstrate a photon-sensitive, three-dimensional camera by active near-infrared illumination and fast time-of-flight gating. It uses pico-second pump pulses to selectively up-convert the backscattered photons according to their spatiotemporal modes via sum-frequency generation in a \c{hi}2 nonlinear crystal, which are then detected by electron-multiplying CCD with photon sensitive detection. As such, it achieves sub-millimeter depth resolution, exceptional noise suppression, and high detection sensitivity. Our results show that it can accurately reconstruct the surface profiles of occluded…
We present a simple and compact approach of structured illumination microscopy by using three $2\times2$ fiber couplers and one $1\times4$ MEMS optics switch. One uniform and three fringe illumination patterns were produced by placing seven output fiber tips at the conjugate Fourier plane of the illumination path. Stable and relatively high-speed illumination switching was achieved by the optics switch. Super-resolution and optical sectioned information was reconstructed from 4-frame data by using algorithms based on a joint Richardson-Lucy deconvolution method and a Hilbert transform method. …
Current optoacoustic microscopy configurations often have narrow focal ranges that limit their use for fast volumetric imaging applications. Here, the focal range of optoacoustic microscopes is extended by matching the elongated optical illumination profile of a Bessel beam with the pencil beam acoustic sensitivity profile of a broadband axicon detector. An inverted optoacoustic microscope was developed with interchangeable optical illumination and acoustic detection units to assess the imaging depths and resolutions retained with several combinations of illumination and detection profiles. Ma…
Quantitative phase microscopy (QPM) is often based on recording an object-reference interference pattern and its further phase demodulation. We propose Pseudo Hilbert Phase Microscopy (PHPM) where we combine pseudo thermal light source illumination and Hilbert spiral transform phase demodulation to achieve hybrid hardware-software-driven noise robustness and increase in resolution of single-shot coherent QPM. Those advantageous features stem from physically altering the laser spatial coherence and numerically restoring spectrally overlapped object spatial frequencies. Capabilities of the PHPM …
Wide-field fluorescence microscopy, while much faster than confocal microscopy, suffers from a lack of optical sectioning and poor axial resolution. 3D structured illumination microscopy (SIM) has been demonstrated to provide optical sectioning and to double the achievable resolution both laterally and axially, but even with this the axial resolution is still worse than the lateral resolution of unmodified wide-field detection. Interferometric schemes using two high numerical aperture objectives, such as 4Pi confocal and I5S microscopy, have improved the axial resolution beyond that of the lat…
This Letter presents the first demonstration of multi-tile stitching for large scale 3D imaging in single objective light-sheet microscopy. We show undistorted 3D imaging spanning complete zebrafish larvae, and over 1 mm3 volumes for thick mouse brain sections. We use remote galvo scanning for light-sheet creation and develop a processing pipeline for 3D tiling across different axes. With the improved one photon (1p) tilt-invariant scanned oblique plane illumination (SOPi) microscope presented here, we demonstrate cellular resolution imaging at depths exceeding 330 um in optically scattering m…
Phase contrast techniques, such as differential interference contrast (DIC) microscopy, are widely used to provide morphological images of unstained biological samples. The trans-illumination geometry required for these techniques has restricted their application to thin samples. We introduce oblique back-illumination microscopy (OBM), a method of collecting en face phase gradient images of thick scattering samples, enabling near video-rate in vivo phase imaging with a miniaturized probe suitable for endoscopy.
We propose a chiral imaging modality based on optical chirality engineering, fluorescence-detected circular dichroism and structured illumination microscopy. In this method, the optical chirality of the illumination is structured and the circular dichroism dependent fluorescence is detected. With image reconstruction, the spatial distribution of chiral domains can be obtained at sub-diffraction limited resolution. We theoretically demonstrate this method and discuss the feasibility using an optical chirality engineering approach based on far-field optics.
For quantitative phase imaging (QPI) based on transport-of-intensity equation (TIE), partially coherent illumination provides speckle-free imaging, compatibility with brightfield microscopy, and transverse resolution beyond coherent diffraction limit. Unfortunately, in a conventional microscope with circular illumination aperture, partial coherence tends to diminish the phase contrast, exacerbating the inherent noise-to-resolution tradeoff in TIE imaging, resulting in strong low-frequency artifacts and compromised imaging resolution. Here, we demonstrate how these issues can be effectively add…
Structured illumination microscopy (SIM) achieves doubled spatial resolution by exciting the specimen with a high-contrast, high-frequency sinusoidal pattern. Such an excitation pattern can be generated by interference between multiple laser beams, which are diffracted from a grating. In SIM, 2D imaging requires 9 patterns and 3D imaging requires 15 patterns. Compared to mechanical movement of gratings, opti-electro devices provide rapid switch of the excitation patterns, in which Digital Micro-mirror Device (DMD) is most common in industry. Here we model DMD as the blazed grating and report a…
We propose to enhance the performance of localized plasmon structured illumination microscopy (LP-SIM) via intensity correlations. LP-SIM uses sub-wavelength illumination patterns to encode high spatial frequency information. It can enhance the resolution up to three-fold before gaps in the OTF support arise. For blinking fluorophores or for quantum antibunching an intensity correlation analysis induces higher harmonics of the illumination pattern and enlarges the effective OTF. This enables ultrahigh resolutions without gaps in the OTF support, and thus a fully deterministic imaging scheme. W…
Modern optical microscopy methods have been advanced to provide super resolution at high imaging speed, but not chirality discriminative. We recently proposed chiral structured-illumination microscopy (SIM) method to image chiral fluorescent domains at sub-wavelength resolution. Chiral SIM is suitable for imaging chiral domains at sub-wavelength resolution but loses the high spatial frequency of the achiral ones. In order to obtain the full picture of all fluorescent domains at sub-wavelength resolution, we propose an advanced version of chiral SIM, termed double SIM, which enables simultaneou…
Recently, chiral structured illumination microscopy has been proposed to image fluorescent chiral domains at sub-wavelength resolution. Chiral structured illumination microscopy is based on the combination of structured illumination microscopy, fluorescence-detected circular dichroism, and optical chirality engineering. Since circular dichroism of natural chiral molecules is typically weak, the differential fluorescence is also weak and can be easily buried by the noise, hampering the fidelity of the reconstructed images. In this work, we systematically study the impact of the noise on the qua…
Structured illumination microscopy (SIM) has emerged as an essential technique for 3D and live-cell super-resolution imaging. However, to date, there has not been a dedicated workshop or journal issue covering the various aspects of SIM, from bespoke hardware and software development and the use of commercial instruments to biological applications. This special issue aims to recap recent developments as well as outline future trends. In addition to SIM, we cover related topics such as complementary super-resolution microscopy techniques, computational imaging, visualisation and image processin…
We present experimental demonstration of tilt-mirror assisted transmission structured illumination microscopy (tSIM) that offers a large field of view super resolution imaging. An assembly of custom-designed tilt-mirrors are employed as the illumination module where the sample is excited with the interference of two beams reflected from the opposite pair of mirror facets. Tunable frequency structured patterns are generated by changing the mirror-tilt angle and the hexagonal-symmetric arrangement is considered for the isotropic resolution in three orientations. Utilizing high numerical aperture…
High-content biological microscopy targets high-resolution imaging across large fields-of-view (FOVs). Recent works have demonstrated that computational imaging can provide efficient solutions for high-content microscopy. Here, we use speckle structured illumination microscopy (SIM) as a robust and cost-effective solution for high-content fluorescence microscopy with simultaneous high-content quantitative phase (QP). This multi-modal compatibility is essential for studies requiring cross-correlative biological analysis. Our method uses laterally-translated Scotch tape to generate high-resoluti…
We report experimental results on heterodyne holographic microscopy of subwavelength-sized gold particles. The apparatus uses continuous green laser illumination of the metal beads in a total internal reflection configuration for dark-field operation. Detection of the scattered light at the illumination wavelength on a charge-coupled device array detector enables 3D localization of brownian particles in water
The performance of light-field microscopy is improved by selectively illuminating the relevant subvolume of the specimen with a second objective lens [1-3]. Here we advance this approach to a single-objective geometry, using an oblique one-photon illumination path or two-photon illumination to accomplish selective-volume excitation. The elimination of the second orthogonally oriented objective to selectively excite the volume of interest simplifies specimen mounting; yet, this single-objective approach still reduces out-of-volume background, resulting in improvements in image contrast, effecti…
Plasmonic hyperbolic metasurfaces have emerged as an effective platform for manipulating the propagation of light. Here, confined modes on arrays of silver nanoridges that exhibit hyperbolic dispersion are used to demonstrate and model a super-resolution imaging technique based on structured illumination microscopy. A spatial resolution of ~75 nm at 458 nm is demonstrated, which is 3.1 times better than an equivalent diffraction limited image. This work emphasizes the ability to engineer the properties of confined optical modes and to leverage those characteristics for applications in imaging.…
Fourier ptychographic microscopy (FPM) is a recently developed computational imaging technique for wide-field, high-resolution microscopy with a high space-bandwidth product. It integrates the concepts of synthetic aperture and phase retrieval to surpass the resolution limit imposed by the employed objective lens. In the FPM framework, the position of each sub-spectrum needs to be accurately known to ensure the success of the phase retrieval process. Different from the conventional methods with mechanical adjustment or data-driven optimization strategies, here we report a physics-based defocus…
Structured illumination microscopy (SIM) provides images of fluorescent objects at an enhanced resolution greater than that of conventional epifluorescence wide-field microscopy. Initially demonstrated in 1999 to enhance the lateral resolution two-fold, it has since been extended to enhance axial resolution two-fold (2008), applied to live-cell imaging (2009) and combined with myriad other techniques, including interferometric detection (2008), confocal microscopy (2010) and light sheet illumination (2012). Despite these impressive developments, SIM remains, perhaps, the most poorly understood…
Speckle patterns have been widely used in imaging techniques such as ghost imaging, dynamic speckle illumination microscopy, structured illumination microscopy, and photoacoustic fluctuation imaging. Recent advances in the ability to control the statistical properties of speckles has enabled the customization of speckle patterns for specific imaging applications. In this work, we design and create special speckle patterns for parallelized nonlinear pattern-illumination microscopy based on fluorescence photoswitching. We present a proof-of-principle experimental demonstration where we obtain a …
A method is proposed for assessing the temporal resolution of Structured Illumination Microscopy (SIM), by tracking the amplitude of different spatial frequency components over time, and comparing them to a temporally-oscillating ground-truth. This method is used to gain insight into the performance limits of SIM, along with alternative reconstruction techniques (termed 'rolling SIM') that claim to improve temporal resolution. Results show that the temporal resolution of SIM varies considerably between low and high spatial frequencies, and that, despite being used in several high profile paper…
Intensity correlation microscopy (ICM), which is prominently known through antibunching microscopy or super-resolution optical fluctuation imaging (SOFI), provides superresolution through a correlation analysis of antibunching of independent quantum emitters or temporal fluctuations of blinking fluorophores. For correlation order $m$ the PSF in the signal is effectively taken to the $m$th power, and is thus directly shrunk by the factor $\sqrt{m}$. Combined with deconvolution a close to linear resolution improvement of factor $m$ can be obtained. Yet, analysis of high correlation orders is cha…
Differential phase contrast microscopy (DPC) provides high-resolution quantitative phase distribution of thin transparent samples under multi-axis asymmetric illuminations. Typically, illumination in DPC microscopic systems is designed with 2-axis half-circle amplitude patterns, which, however, result in a non-isotropic phase contrast transfer function (PTF). Efforts have been made to achieve isotropic DPC by replacing the conventional half-circle illumination aperture with radially asymmetric patterns with 3-axis illumination or gradient amplitude patterns with 2-axis illumination. Neverthele…
We propose to use intensity correlation microscopy in combination with structured illumination to image quantum emitters that exhibit antibunching with a spatial resolution reaching far beyond the Rayleigh limit. Combining intensity measurements and intensity auto correlations up to order $m$ creates an effective PSF with FWHM shrunk by the factor $\sqrt{m}$. Structured Illumination microscopy on the other hand introduces a resolution improvement of factor 2 by use of the principle of moiré fringes. Here, we show that for linear low-intensity excitation and linear optical detection the simulta…
Structured illumination microscopy (SIM) can double the resolution beyond the light diffraction limit, but it comes at the cost of multiple camera exposures and the heavy computation burden of multiple Fourier transforms. In this paper, we report a novel technique termed single-shot SIM, to overcome these limitations. A multi-task joint deep-learning strategy is proposed. Generative adversative networks (GAN) are employed to generate five structured illumination images based on the single-shot structured illumination image. U-Net is employed to reconstruct the super-resolution image from these…
Illumination uniformity is a critical parameter for excitation and data extraction quality in widefield biological imaging applications. However, typical imaging systems suffer from spatial and spectral non-uniformity due to non-ideal optical elements, thus require complex solutions for illumination corrections. We present Effective Uniform Color-Light Integration Device (EUCLID), a simple and cost-effective illumination source for uniformity corrections. EUCLID employs a diffuse-reflective, adjustable hollow cavity that allows for uniform mixing of light from discrete light sources and modifi…
University of California, Berkeley（加州大学伯克利分校）；Boston University（波士顿大学）
Structured illumination microscopy (SIM) improves resolution by down-modulating high-frequency information of an object to fit within the passband of the optical system. Generally, the reconstruction process requires prior knowledge of the illumination patterns, which implies a well-calibrated and aberration-free system. Here, we propose a new \textit{algorithmic self-calibration} strategy for SIM that does not need to know the exact patterns {\it a priori}, but only their covariance. The algorithm, termed PE-SIMS, includes a Pattern-Estimation (PE) step requiring the uniformity of the sum of …
We demonstrate a three-dimensional (3D) optical diffraction tomographic technique with optimal frequency combination (OFC-ODT) for the 3D quantitative phase imaging of unlabeled specimens. Three sets of through-focus intensity images are captured under an annular aperture and two circular apertures with different coherence parameters. The 3D phase optical transfer functions (POTF) corresponding to different illumination apertures are combined to obtain an optimally synthesized frequency response, achieving high-quality, low-noise 3D reconstructions with imaging resolution up to the incoherent …
In this paper, a method for increasing the temporal resolution of a temporal imaging system has been developed. Analogously to the conventional spatial imaging systems in which resolution limit is due to the finite aperture of the lens, in a temporal imaging system, finite temporal aperture of the time lens is responsible for limited temporal resolution. Based on the method used in spatial structured illumination super-resolution microscopy in spatial optics, we have utilized time prisms, which are temporal versions of conventional prisms, to shift the illusive frequency components of the inpu…
Fluorescence polarization microscopy images both the intensity and orientation of fluorescent dipoles, which plays a vital role in studying the molecular structure and dynamics of bio-complex. However, it is difficult to resolve the dipole assemblies on the subcellular structure and their dynamics in living cells with super-resolution. Here we report polarized structured illumination microscopy (pSIM), which decouples the entangled spatial and angular structured illumination through interpreting the dipoles in spatio-angular hyperspace. We demonstrate its application on a series of biological …
Sub-diffraction resolution, gentle sample illumination, and the possibility to image in multiple colors make Structured Illumination Microscopy (SIM) an imaging technique which is particularly well suited for live cell observations. Here, we present Machine learning Assisted Interferometric-SIM (MAI-SIM), an easy-to-implement method for high speed SIM imaging in multiple colors. The instrument is based on an interferometer design in which illumination patterns are generated, rotated, and stepped in phase through movement of a single galvanometric mirror element. The design is robust, flexible,…
The structured illumination (SI) architecture can be adopted in a digital holographic (DH) microscope to enhance the spatial resolution. In this paper, we propose and demonstrate a compact and simple SI method in a self-referencing common-path configuration of DH microscopy. The combination of SI pattern generated by a compact disk and common-path off-axis geometry formed by Fresnel biprism introduces a low-cost and highly stable system to image both amplitude and phase objects with a twofold improvement of the spatial resolution. Experimental results for the case of a standard test sample val…
In most biological tissues, light scattering due to small differences in refractive index limits the depth of optical imaging systems. Two-photon microscopy (2PM), which significantly reduces the scattering of the excitation light, has emerged as the most common method to image deep within scattering biological tissue. This technique, however, requires high-power pulsed lasers that are both expensive and difficult to integrate into compact portable systems. In this paper, using a combination of theoretical and experimental techniques, we show that Selective Plane Illumination Microscopy (SPIM)…
