Multiwavelength photoacoustic images encode information about a tissue's optical absorption distribution. This can be used to estimate its blood oxygen saturation distribution (sO2), an important physiological indicator of tissue health and pathology. However the wavelength dependence of the light fluence distribution complicates the recovery of accurate estimates, in particular, preventing the use of a straightforward spectroscopic inversion. Deep learning approaches have been shown effective at producing accurate estimates of sO2 from simulated data. Though, the translation of generic supervised learning approaches to real tissues is prevented by the lack of real `paired' training data (multiwavelength PA images of in vivo tissues with their corresponding sO2 distributions). Here, we discuss i) why networks trained on images simulated using conventional means are unlikely to generalise their performance on real tissues, and ii) the prospects of using two generative adversarial network based strategies to improve the generalisability of sO2-estimating networks trained on synthetic data: a) CycleGAN-driven unsupervised domain adaptation of conventionally simulated images, and b) the generation of paired training data using AmbientGANs.
Forward and adjoint Monte Carlo (MC) models of radiance are proposed for use in model-based quantitative photoacoustic tomography. A 2D radiance MC model using a harmonic angular basis is introduced and validated against analytic solutions for the radiance in heterogeneous media. A gradient-based optimisation scheme is then used to recover 2D absorption and scattering coefficients distributions from simulated photoacoustic measurements. It is shown that the functional gradients, which are a challenge to compute efficiently using MC models, can be calculated directly from the coefficients of th…
Photoacoustic Computed Tomography (PACT) is a major configuration of photoacoustic imaging, a hybrid noninvasive modality for both functional and molecular imaging. PACT has rapidly gained importance in the field of biomedical imaging due to superior performance as compared to conventional optical imaging counterparts. However, the overall cost of developing a PACT system is one of the challenges towards clinical translation of this novel technique. The cost of a typical commercial PACT system originates from optical source, ultrasound detector, and data acquisition unit. With growing applicat…
Photoacoustic tomography (PAT) is intrinsically sensitive to blood oxygen saturation (sO2) in vivo. However, making accurate sO2 measurements without knowledge of tissue- and instrumentation-related correction factors is extremely challenging. We have developed a low-cost flow phantom system to facilitate validation of photoacoustic tomography systems. The phantom is composed of a flow circuit, which is partially embedded within a tissue mimicking phantom, with independent sensors providing online monitoring of the optical absorption spectrum and partial pressure of oxygen in the tube. We firs…
We propose a combined reconstruction-classification method for simultaneously recovering absorption and scattering in turbid media from images of absorbed optical energy. This method exploits knowledge that optical parameters are determined by a limited number of classes to iteratively improve their estimate. Numerical experiments show that the proposed approach allows for accurate recovery of absorption and scattering in 2 and 3 dimensions, and delivers superior image quality with respect to traditional reconstruction-only approaches.
Quantitative photoacoustic tomography aims at estimating optical parameters from photoacoustic images that are formed utilizing the photoacoustic effect caused by the absorption of an externally introduced light pulse. This optical parameter estimation is an ill-posed inverse problem, and thus it is sensitive to measurement and modeling errors. In this work, we propose a novel way to solve the inverse problem of quantitative photoacoustic tomography based on the perturbation Monte Carlo method. Monte Carlo method for light propagation is a stochastic approach for simulating photon trajectories…
We present a photoacoustic computed tomography investigation on a healthy human finger, to image blood vessels with a focus on vascularity across the interphalangeal joints. The cross-sectional images were acquired using an imager specifically developed for this purpose. The images show rich detail of the digital blood vessels with diameters between 100 $μ$m and 1.5 mm in various orientations and at various depths. Different vascular layers in the skin including the subpapillary plexus could also be visualized. Acoustic reflections on the finger bone of photoacoustic signals from skin were vis…
Herein we report the first in-human transcranial imaging of brain function using photoacoustic computed tomography. Functional responses to benchmark motor tasks were imaged on both the skull-less and the skull-intact hemispheres of a hemicraniectomy patient. The observed brain responses in these preliminary results demonstrate the potential of photoacoustic computed tomography for achieving transcranial functional imaging.
Acoustic lenses made of acrylic plastic (PMMA) have been used to enlarge the acceptance angle of sensitive large surface area detectors and improve lateral resolution. However, PMMA lenses introduce image artifacts due to ultrasound internal reflections within the lenses. In this work we investigated this issue proposing a new lens material Stycast 1090SI. We characterized the acoustic properties of the proposed material in comparison with PMMA. Detector performance using negative lenses with the two materials, was tested using finite element simulation and experiment. Further the image qualit…
This paper presents a numerical study on a fast marching method based back projection reconstruction algorithm for photoacoustic tomography in heterogeneous media. Transcranial imaging is used here as a case study. To correct for the phase aberration from the heterogeneity (i.e., skull), the fast marching method is adopted to compute the phase delay based on the known speed of sound distribution, and the phase delay is taken into account by the back projection algorithm for more accurate reconstructions. It is shown that the proposed algorithm is more accurate than the conventional back projec…
Photoacoustic computed tomography (PACT) is an emerging imaging modality that exploits optical contrast and ultrasonic detection principles to form images of the photoacoustically induced initial pressure distribution within tissue. The PACT reconstruction problem corresponds to an inverse source problem in which the initial pressure distribution is recovered from measurements of the radiated wavefield. A major challenge in transcranial PACT brain imaging is compensation for aberrations in the measured data due to the presence of the skull. Ultrasonic waves undergo absorption, scattering and l…
Photoacoustic imaging of interphalangeal peripheral joints is of interest in the context of using the synovial membrane as a surrogate marker of rheumatoid arthritis. Previous work has shown that ultrasound produced by absorption of light at the epidermis reflects on the bone surfaces within the finger. When the reflected signals are backprojected in the region of interest, artifacts are produced, confounding interpretation of the images. In this work, we present an approach where the photoacoustic signals known to originate from the epidermis, are treated as virtual ultrasound transmitters, a…
Early diagnosis of ocular diseases improves the understanding of pathophysiology and helps with accurate monitoring and effective treatment. Advanced multimodal ocular imaging platforms play a crucial role in the visualization of the ocular components and provide clinicians with a valuable tool for evaluating different eye diseases. Here, for the first time, we present a non-contact, multimodal photoacoustic remote sensing (PARS) microscopy and swept-source optical coherence tomography (SS-OCT) for in-vivo functional and structural imaging of the eye. The system provides complementary imaging …
Photoacoustic computed tomography (PACT) is a rapidly emerging bioimaging modality that seeks to reconstruct an estimate of the absorbed optical energy density within an object. Conventional PACT image reconstruction methods assume a constant speed-of-sound (SOS), which can result in image artifacts when acoustic aberrations are significant. It has been demonstrated that incorporating knowledge of an object's SOS distribution into a PACT image reconstruction method can improve image quality. However, in many cases, the SOS distribution cannot be accurately and/or conveniently estimated prior t…
Photoacoustic computed tomography (PACT) is an emerging computed imaging modality that exploits optical contrast and ultrasonic detection principles to form images of the absorbed optical energy density within tissue. When the imaging system employs conventional piezoelectric ultrasonic transducers, the ideal photoacoustic (PA) signals are degraded by the transducers' acousto-electric impulse responses (EIRs) during the measurement process. If unaccounted for, this can degrade the accuracy of the reconstructed image. In principle, the effect of the EIRs on the measured PA signals can be amelio…
Fully three-dimensional sound speed-corrected multi-wavelength photoacoustic breast tomography
University of Twente（特温特大学）；Centrum Wiskunde & Informatica（数学与计算机科学中心）；University College London（伦敦大学学院）；Medisch Spectrum Twente Hospital（特温特医学频谱医院）；P.A. Imaging R&D B.V.；Brno University of Technology（布尔诺理工大学）；Imasonic SAS；Ekspla UAB；Leiden University Medical Center（莱顿大学医学中心）；Center for Physical Science and Technology（物理科学与技术中心）；Ziekenhuisgroep Twente（特温特医院集团）
We have developed a multimodal photoacoustic remote sensing (PARS) microscope combined with swept source optical coherence tomography for in vivo, non-contact retinal imaging. Building on the proven strength of multiwavelength PARS imaging, the system is applied for estimating retinal oxygen saturation in the rat retina. The capability of the technology is demonstrated by imaging both microanatomy and the microvasculature of the retina in vivo. To our knowledge this is the first time a non-contact photoacoustic imaging technique is employed for in vivo oxygen saturation measurement in the reti…
Non-invasive imaging of deep blood vessels for mapping hemodynamics remains an open quest in biomedical optical imaging. Although pure optical imaging techniques offer rich optical contrast of blood and have been reported to measure blood flow, they are generally limited to surface imaging within the optical diffusion limit of about one millimeter. Herein, we present photoacoustic vector tomography (PAVT), breaking through the optical diffusion limit to image deep blood flow with speed and direction quantification. PAVT synergizes the spatial heterogeneity of blood and the photoacoustic contra…
Photoacoustic computed tomography (PACT) is an emerging computed imaging modality that exploits optical contrast and ultrasonic detection principles to form images of the absorbed optical energy density within tissue. If the object possesses spatially variant acoustic properties that are unaccounted for by the reconstruction method, the estimated image can contain distortions. While reconstruction methods have recently been developed to compensate for this effect, they generally require the object's acoustic properties to be known a priori. To circumvent the need for detailed information regar…
Photoacoustic computed tomography (PACT), also known as optoacoustic tomography, is an emerging imaging modality that has great potential for a wide range of biomedical imaging applications. In this Note, we derive a hybrid reconstruction formula that is mathematically exact and operates on a data function that is expressed in the temporal frequency and spatial domains. This formula explicitly reveals new insights into how the spatial frequency components of the sought-after object function are determined by the temporal frequency components of the data function measured with a circular or sph…
The quality of the reconstructed photoacoustic image largely depends on the amount of photoacoustic (PA) boundary data available, which in turn is proportional to the number of detectors employed. In case of limited data (owing to less number of detectors due to cost/instrumentation constraints), the reconstructed PA images suffer from artifacts and are often noisy. In this work, for the first time, a deep learning based model was developed to super resolve and denoise the photoacoustic sinogram data. The proposed method was compared with existing nearest neighbor interpolation and wavelet bas…
The formation of amyloid plaques in the cortical and hippocampal brain regions caused by abnormal deposition of extracellular amyloid \b{eta}-protein (A\b{eta}) is a characteristic pathological hallmark of early Alzheimer's disease (AD), while label-free graphic rendering of diseased amyloid plaques in vivo is still a highly challenging task. Herein, by ingeniously extracting the polarization-sensitive optical absorption of amyloid plaques via photoacoustic (PA) technique, a novel PA Mueller matrix (PAMM) tomography that capable of providing three new conformational parameters of molecules is …
Photoacoustic tomography (PAT) combines the advantages of the spectroscopic optical absorption contrast and acoustic resolution with deep penetration, and becomes an important novel biomedical imaging technology for scientific research and clinical diagnosis. In this paper, an imaging size-adjustable PAT system is proposed for clinical applications, which can adapt for different size imaging targets. Comparing with the conventional PAT system setup which with a fixed radius ring shape ultrasound transducer (UT) array, the proposed system, which is based on sectorial ultrasound transducer array…
In most photoacoustic (PA) measurements, variations in speed-of-sound (SOS) of the subject are neglected under the assumption of acoustic homogeneity. Biological tissue with spatially heterogeneous SOS cannot be accurately reconstructed under this assumption. We present experimental and image reconstruction methods with which 2-D SOS distributions can be accurately acquired and reconstructed, and with which the SOS map can be used subsequently to reconstruct highly accurate PA tomograms. We begin with a 2-D iterative reconstruction approach in an ultrasound transmission tomography (UTT) settin…
George Mason University（乔治梅森大学）；The MITRE Corporation（MITRE公司）
Photoacoustic tomography (PAT) is a nonionizing imaging modality capable of acquiring high contrast and resolution images of optical absorption at depths greater than traditional optical imaging techniques. Practical considerations with instrumentation and geometry limit the number of available acoustic sensors and their view of the imaging target, which result in significant image reconstruction artifacts degrading image quality. Iterative reconstruction methods can be used to reduce artifacts but are computationally expensive. In this work, we propose a novel deep learning approach termed pi…
University of Vienna（维也纳大学）；Christian Doppler Laboratory for Mathematical Modeling and Simulation of Next Generations of Ultrasound Devices (MaMSi)（下一代超声设备数学建模与模拟克里斯蒂安·多普勒实验室）；Johann Radon Institute for Computational and Applied Mathematics (RICAM)（约翰·拉登计算与应用数学研究所）；Medical University of Vienna（维也纳医科大学）
Photoacoustic computed tomography (PACT) combines the optical contrast of optical imaging and the penetrability of sonography. In this work, we develop a novel PACT system to provide real-time imaging, which is achieved by a 120-elements ultrasound array only using a single data acquisition (DAQ) channel. To reduce the channel number of DAQ, we superimpose 30 nearby channels' signals together in the analog domain, and shrinking to 4 channels of data (120/30=4). Furthermore, a four-to-one delay-line module is designed to combine these four channels' data into one channel before entering the sin…
Idier et al. [IEEE Trans. Comput. Imaging 4(1), 2018] propose a method which achieves superresolution in the microscopy setting by leveraging random speckle illumination and knowledge about statistical second order moments for the illumination patterns and model noise. This is achieved without any assumptions on the sparsity of the imaged object. In this paper, we show that their technique can be extended to photoacoustic tomography. We propose a simple algorithm for doing the reconstruction which only requires a small number of linear algebra steps. It is therefore much faster than the iterat…
The penetration depth of photoacoustic imaging in biological tissues has been fundamentally limited by the strong optical attenuation when light is delivered externally through the tissue surface. To address this issue, we previously reported internal-illumination photoacoustic imaging using a customized radial-emission optical fiber diffuser, which, however, has complex fabrication, high cost, and non-uniform light emission. To overcome these shortcomings, we have developed a new type of low-cost fiber diffusers based on a graded-scattering method in which the optical scattering of the fiber …
Photoacoustic imaging has proven to be able to detect vascularization-driven optical absorption contrast associated with tumors. In order to detect breast tumors located a few centimeter deep in tissue, a sensitive ultrasound detector is of crucial importance for photoacoustic mammography. Further, because the expected photoacoustic frequency bandwidth (a few MHz to tens of kHz) is inversely proportional to the dimensions of light absorbing structures (0.5 to 10+ mm), proper choices of materials and their geometries, and proper considerations in design have to be made for optimal photoacoustic…
Photoacoustic computed tomography (PACT), also known as optoacoustic tomography, is an emerging imaging technique that holds great promise for biomedical imaging. PACT is a hybrid imaging method that can exploit the strong endogenous contrast of optical methods along with the high spatial resolution of ultrasound methods. In its canonical form that is addressed in this article, PACT seeks to estimate the photoacoustically-induced initial pressure distribution within the object. Image reconstruction methods are employed to solve the acoustic inverse problem associated with the image formation p…
Histological images are critical in the diagnosis and treatment of cancers. Unfortunately, the current method for capturing these microscopy images require resource intensive tissue preparation that delays diagnosis for many days to a few weeks. To streamline this process, clinicians are limited to assessing small macroscopically representative subsets of tissues. Here, we present a combined photoacoustic remote sensing (PARS) microscope and swept source optical coherence tomography (SS-OCT) system designed to circumvent these diagnostic limitations. The proposed multimodal microscope provides…
Photoacoustic computed tomography (PACT) is a hybrid imaging modality, which combines the high optical contrast of pure optical imaging and the high penetration depth of ultrasound imaging. However, photoacoustic image dataset with good quality and large quantity is lacking. In this paper, we mainly talk about how to generate a practical photoacoustic dataset. Firstly, we extracted 389 3D vessel volumes from CT whole-lung scan database, and enhanced the blood vessel structures. Then for each 3D vessel volume, we embedded it into a three-layer cubic phantom to formulate a skin tissue model, whi…
A New Sparsification and Reconstruction Strategy for Compressed Sensing Photoacoustic Tomography
Christian Doppler Laboratory for Photoacoustic Imaging and Laser Ultrasonics（光声成像和激光超声学 Christian Doppler 实验室）；Research Center for Non-Destructive Testing (RECENDT)（无损检测研究中心 (RECENDT)）；Department of Mathematics, University of Idaho（爱达荷大学数学系）
Revisiting the joint estimation of initial pressure and speed-of-sound distributions in photoacoustic computed tomography with consideration of canonical object constraints
Image sensors are the backbone of many imaging technologies of great importance to modern sciences, being particularly relevant in biomedicine. An ideal image sensor should be usable through all the electromagnetic spectrum (large bandwidth), it should be fast (millions of frames per second) to fulfil the needs of many microscopy applications, and it should be cheap, in order to ensure the sustainability of the healthcare system. However, current image sensor technologies have fundamental limitations in terms of bandwidth, imaging rate or price. In here, we briefly sketch the principles of an …
As an emerging medical diagnostic technology, photoacoustic imaging has been implemented for both preclinical and clinical applications. For clinical convenience, a handheld free scan photoacoustic tomography (PAT) system providing 3D imaging capability is essentially needed, which has potential for surgical navigation and disease diagnosis. In this paper, we proposed a free scan 3D PAT (fsPAT) system based on a handheld linear array ultrasound probe. A global positioning system (GPS) is applied for ultrasound probes coordinate acquisition. The proposed fsPAT can simultaneously realize real ti…
Photoacoustic computed tomography (PACT) detects light-induced ultrasound waves to reconstruct the optical absorption contrast of the biological tissues. Due to its relatively deep penetration (several centimeters in soft tissue), high spatial resolution, and inherent functional sensitivity, PACT has great potential for imaging mouse brains with endogenous and exogenous contrasts, which is of immense interest to the neuroscience community. However, conventional PACT either assumes homogenous optical fluence within the brain or uses a simplified attenuation model for optical fluence estimation.…
German Cancer Research Center (DKFZ)（德国癌症研究中心（DKFZ））；Heidelberg University（海德堡大学）；Heidelberg University Hospital（海德堡大学医院）
Purpose: Photoacoustic tomography (PAT) is a novel imaging technique that can spatially resolve both morphological and functional tissue properties, such as the vessel topology and tissue oxygenation. While this capacity makes PAT a promising modality for the diagnosis, treatment and follow-up of various diseases, a current drawback is the limited field-of-view (FoV) provided by the conventionally applied 2D probes. Methods: In this paper, we present a novel approach to 3D reconstruction of PAT data (Tattoo tomography) that does not require an external tracking system and can smoothly be integ…
Application of a Virtual Imaging Framework for Investigating a Deep Learning-Based Reconstruction Method for 3D Quantitative Photoacoustic Computed Tomography
organization= Department of Electrical \& Computer Engineering, University of Illinois Urbana-Champaign , postcode= 61801 , state= IL , country= USA；organization= Department of Bioengineering, University of Illinois Urbana-Champaign , postcode= 61801 , state= IL , country= USA；organization= Oden Institute for Computational Engineering；Sciences, The University of Texas at Austin , postcode= 78712 , state= TX , country= USA；organization= Department of Biomedical Engineering, The University of Texas at Austin , postcode= 78712 , state= TX , country= USA
