Application of a Virtual Imaging Framework for Investigating a Deep Learning-Based Reconstruction Method for 3D Quantitative Photoacoustic Computed Tomography
organization= Department of Electrical \& Computer Engineering, University of Illinois Urbana-Champaign , postcode= 61801 , state= IL , country= USA；organization= Department of Bioengineering, University of Illinois Urbana-Champaign , postcode= 61801 , state= IL , country= USA；organization= Oden Institute for Computational Engineering；Sciences, The University of Texas at Austin , postcode= 78712 , state= TX , country= USA；organization= Department of Biomedical Engineering, The University of Texas at Austin , postcode= 78712 , state= TX , country= USA
Refik Mert Cam, Seonyeong Park, Umberto Villa, Mark A. Anastasio
Quantitative photoacoustic computed tomography (qPACT) is a promising imaging modality for estimating physiological parameters such as blood oxygen saturation. However, developing robust qPACT reconstruction methods remains challenging due to computational demands, modeling difficulties, and experimental uncertainties. Learning-based methods have been proposed to address these issues but remain largely unvalidated. Virtual imaging (VI) studies are essential for validating such methods early in development, before proceeding to less-controlled phantom or in vivo studies. Effective VI studies must employ ensembles of stochastically generated numerical phantoms that accurately reflect relevant anatomy and physiology. Yet, most prior VI studies for qPACT relied on overly simplified phantoms. In this work, a realistic VI testbed is employed for the first time to assess a representative 3D learning-based qPACT reconstruction method for breast imaging. The method is evaluated across subject variability and physical factors such as measurement noise and acoustic aberrations, offering insights into its strengths and limitations.
ShanghaiTech University（上海科技大学）；Chinese Academy of Sciences, Shanghai Institute of Microsystem and Information Technology（中国科学院上海微系统与信息技术研究所）；University of Chinese Academy of Sciences（中国科学院大学）
Photoacoustic (PA) computed tomography (PACT) shows great potentials in various preclinical and clinical applications. A great number of measurements are the premise that obtains a high-quality image, which implies a low imaging rate or a high system cost. The artifacts or sidelobes could pollute the image if we decrease the number of measured channels or limit the detected view. In this paper, a novel compressed sensing method for PACT using an untrained neural network is proposed, which decreases half number of the measured channels and recoveries enough details. This method uses a neural ne…
Fast algorithms enabling optimization and deep learning for photoacoustic tomography in a circular detection geometry
Research Unit of Mathematical Sciences, University of Oulu（奥卢大学数学科学研究所）；Department of Computer Science, University College London（伦敦大学学院计算机科学系）；Department of Mathematics, University of Arizona（亚利桑那大学数学系）；Department of Technical Physics, University of Eastern Finland（东部芬兰大学技术物理系）
Herein we report the first in-human transcranial imaging of brain function using photoacoustic computed tomography. Functional responses to benchmark motor tasks were imaged on both the skull-less and the skull-intact hemispheres of a hemicraniectomy patient. The observed brain responses in these preliminary results demonstrate the potential of photoacoustic computed tomography for achieving transcranial functional imaging.
Non-invasive imaging of deep blood vessels for mapping hemodynamics remains an open quest in biomedical optical imaging. Although pure optical imaging techniques offer rich optical contrast of blood and have been reported to measure blood flow, they are generally limited to surface imaging within the optical diffusion limit of about one millimeter. Herein, we present photoacoustic vector tomography (PAVT), breaking through the optical diffusion limit to image deep blood flow with speed and direction quantification. PAVT synergizes the spatial heterogeneity of blood and the photoacoustic contra…
Forward and adjoint Monte Carlo (MC) models of radiance are proposed for use in model-based quantitative photoacoustic tomography. A 2D radiance MC model using a harmonic angular basis is introduced and validated against analytic solutions for the radiance in heterogeneous media. A gradient-based optimisation scheme is then used to recover 2D absorption and scattering coefficients distributions from simulated photoacoustic measurements. It is shown that the functional gradients, which are a challenge to compute efficiently using MC models, can be calculated directly from the coefficients of th…
Photoacoustic Computed Tomography (PACT) is a major configuration of photoacoustic imaging, a hybrid noninvasive modality for both functional and molecular imaging. PACT has rapidly gained importance in the field of biomedical imaging due to superior performance as compared to conventional optical imaging counterparts. However, the overall cost of developing a PACT system is one of the challenges towards clinical translation of this novel technique. The cost of a typical commercial PACT system originates from optical source, ultrasound detector, and data acquisition unit. With growing applicat…
We have developed a multimodal photoacoustic remote sensing (PARS) microscope combined with swept source optical coherence tomography for in vivo, non-contact retinal imaging. Building on the proven strength of multiwavelength PARS imaging, the system is applied for estimating retinal oxygen saturation in the rat retina. The capability of the technology is demonstrated by imaging both microanatomy and the microvasculature of the retina in vivo. To our knowledge this is the first time a non-contact photoacoustic imaging technique is employed for in vivo oxygen saturation measurement in the reti…
Photoacoustic tomography (PAT) is intrinsically sensitive to blood oxygen saturation (sO2) in vivo. However, making accurate sO2 measurements without knowledge of tissue- and instrumentation-related correction factors is extremely challenging. We have developed a low-cost flow phantom system to facilitate validation of photoacoustic tomography systems. The phantom is composed of a flow circuit, which is partially embedded within a tissue mimicking phantom, with independent sensors providing online monitoring of the optical absorption spectrum and partial pressure of oxygen in the tube. We firs…
We propose a combined reconstruction-classification method for simultaneously recovering absorption and scattering in turbid media from images of absorbed optical energy. This method exploits knowledge that optical parameters are determined by a limited number of classes to iteratively improve their estimate. Numerical experiments show that the proposed approach allows for accurate recovery of absorption and scattering in 2 and 3 dimensions, and delivers superior image quality with respect to traditional reconstruction-only approaches.
Quantitative photoacoustic tomography aims at estimating optical parameters from photoacoustic images that are formed utilizing the photoacoustic effect caused by the absorption of an externally introduced light pulse. This optical parameter estimation is an ill-posed inverse problem, and thus it is sensitive to measurement and modeling errors. In this work, we propose a novel way to solve the inverse problem of quantitative photoacoustic tomography based on the perturbation Monte Carlo method. Monte Carlo method for light propagation is a stochastic approach for simulating photon trajectories…
Idier et al. [IEEE Trans. Comput. Imaging 4(1), 2018] propose a method which achieves superresolution in the microscopy setting by leveraging random speckle illumination and knowledge about statistical second order moments for the illumination patterns and model noise. This is achieved without any assumptions on the sparsity of the imaged object. In this paper, we show that their technique can be extended to photoacoustic tomography. We propose a simple algorithm for doing the reconstruction which only requires a small number of linear algebra steps. It is therefore much faster than the iterat…
We present a photoacoustic computed tomography investigation on a healthy human finger, to image blood vessels with a focus on vascularity across the interphalangeal joints. The cross-sectional images were acquired using an imager specifically developed for this purpose. The images show rich detail of the digital blood vessels with diameters between 100 $μ$m and 1.5 mm in various orientations and at various depths. Different vascular layers in the skin including the subpapillary plexus could also be visualized. Acoustic reflections on the finger bone of photoacoustic signals from skin were vis…
Photoacoustic computed tomography (PACT), also known as optoacoustic tomography, is an emerging imaging modality that has great potential for a wide range of biomedical imaging applications. In this Note, we derive a hybrid reconstruction formula that is mathematically exact and operates on a data function that is expressed in the temporal frequency and spatial domains. This formula explicitly reveals new insights into how the spatial frequency components of the sought-after object function are determined by the temporal frequency components of the data function measured with a circular or sph…
Acoustic lenses made of acrylic plastic (PMMA) have been used to enlarge the acceptance angle of sensitive large surface area detectors and improve lateral resolution. However, PMMA lenses introduce image artifacts due to ultrasound internal reflections within the lenses. In this work we investigated this issue proposing a new lens material Stycast 1090SI. We characterized the acoustic properties of the proposed material in comparison with PMMA. Detector performance using negative lenses with the two materials, was tested using finite element simulation and experiment. Further the image qualit…
The quality of the reconstructed photoacoustic image largely depends on the amount of photoacoustic (PA) boundary data available, which in turn is proportional to the number of detectors employed. In case of limited data (owing to less number of detectors due to cost/instrumentation constraints), the reconstructed PA images suffer from artifacts and are often noisy. In this work, for the first time, a deep learning based model was developed to super resolve and denoise the photoacoustic sinogram data. The proposed method was compared with existing nearest neighbor interpolation and wavelet bas…
George Mason University（乔治梅森大学）；The MITRE Corporation（MITRE公司）
Photoacoustic tomography (PAT) is a nonionizing imaging modality capable of acquiring high contrast and resolution images of optical absorption at depths greater than traditional optical imaging techniques. Practical considerations with instrumentation and geometry limit the number of available acoustic sensors and their view of the imaging target, which result in significant image reconstruction artifacts degrading image quality. Iterative reconstruction methods can be used to reduce artifacts but are computationally expensive. In this work, we propose a novel deep learning approach termed pi…
The formation of amyloid plaques in the cortical and hippocampal brain regions caused by abnormal deposition of extracellular amyloid \b{eta}-protein (A\b{eta}) is a characteristic pathological hallmark of early Alzheimer's disease (AD), while label-free graphic rendering of diseased amyloid plaques in vivo is still a highly challenging task. Herein, by ingeniously extracting the polarization-sensitive optical absorption of amyloid plaques via photoacoustic (PA) technique, a novel PA Mueller matrix (PAMM) tomography that capable of providing three new conformational parameters of molecules is …
This paper presents a numerical study on a fast marching method based back projection reconstruction algorithm for photoacoustic tomography in heterogeneous media. Transcranial imaging is used here as a case study. To correct for the phase aberration from the heterogeneity (i.e., skull), the fast marching method is adopted to compute the phase delay based on the known speed of sound distribution, and the phase delay is taken into account by the back projection algorithm for more accurate reconstructions. It is shown that the proposed algorithm is more accurate than the conventional back projec…
Photoacoustic computed tomography (PACT) is an emerging imaging modality that exploits optical contrast and ultrasonic detection principles to form images of the photoacoustically induced initial pressure distribution within tissue. The PACT reconstruction problem corresponds to an inverse source problem in which the initial pressure distribution is recovered from measurements of the radiated wavefield. A major challenge in transcranial PACT brain imaging is compensation for aberrations in the measured data due to the presence of the skull. Ultrasonic waves undergo absorption, scattering and l…
Photoacoustic imaging of interphalangeal peripheral joints is of interest in the context of using the synovial membrane as a surrogate marker of rheumatoid arthritis. Previous work has shown that ultrasound produced by absorption of light at the epidermis reflects on the bone surfaces within the finger. When the reflected signals are backprojected in the region of interest, artifacts are produced, confounding interpretation of the images. In this work, we present an approach where the photoacoustic signals known to originate from the epidermis, are treated as virtual ultrasound transmitters, a…
University of Vienna（维也纳大学）；Christian Doppler Laboratory for Mathematical Modeling and Simulation of Next Generations of Ultrasound Devices (MaMSi)（下一代超声设备数学建模与模拟克里斯蒂安·多普勒实验室）；Johann Radon Institute for Computational and Applied Mathematics (RICAM)（约翰·拉登计算与应用数学研究所）；Medical University of Vienna（维也纳医科大学）
Photoacoustic computed tomography (PACT), also known as optoacoustic tomography, is an emerging imaging technique that holds great promise for biomedical imaging. PACT is a hybrid imaging method that can exploit the strong endogenous contrast of optical methods along with the high spatial resolution of ultrasound methods. In its canonical form that is addressed in this article, PACT seeks to estimate the photoacoustically-induced initial pressure distribution within the object. Image reconstruction methods are employed to solve the acoustic inverse problem associated with the image formation p…
Early diagnosis of ocular diseases improves the understanding of pathophysiology and helps with accurate monitoring and effective treatment. Advanced multimodal ocular imaging platforms play a crucial role in the visualization of the ocular components and provide clinicians with a valuable tool for evaluating different eye diseases. Here, for the first time, we present a non-contact, multimodal photoacoustic remote sensing (PARS) microscopy and swept-source optical coherence tomography (SS-OCT) for in-vivo functional and structural imaging of the eye. The system provides complementary imaging …
Photoacoustic tomography (PAT) combines the advantages of the spectroscopic optical absorption contrast and acoustic resolution with deep penetration, and becomes an important novel biomedical imaging technology for scientific research and clinical diagnosis. In this paper, an imaging size-adjustable PAT system is proposed for clinical applications, which can adapt for different size imaging targets. Comparing with the conventional PAT system setup which with a fixed radius ring shape ultrasound transducer (UT) array, the proposed system, which is based on sectorial ultrasound transducer array…
Histological images are critical in the diagnosis and treatment of cancers. Unfortunately, the current method for capturing these microscopy images require resource intensive tissue preparation that delays diagnosis for many days to a few weeks. To streamline this process, clinicians are limited to assessing small macroscopically representative subsets of tissues. Here, we present a combined photoacoustic remote sensing (PARS) microscope and swept source optical coherence tomography (SS-OCT) system designed to circumvent these diagnostic limitations. The proposed multimodal microscope provides…
Photoacoustic computed tomography (PACT) is a rapidly emerging bioimaging modality that seeks to reconstruct an estimate of the absorbed optical energy density within an object. Conventional PACT image reconstruction methods assume a constant speed-of-sound (SOS), which can result in image artifacts when acoustic aberrations are significant. It has been demonstrated that incorporating knowledge of an object's SOS distribution into a PACT image reconstruction method can improve image quality. However, in many cases, the SOS distribution cannot be accurately and/or conveniently estimated prior t…
Photoacoustic computed tomography (PACT) combines the optical contrast of optical imaging and the penetrability of sonography. In this work, we develop a novel PACT system to provide real-time imaging, which is achieved by a 120-elements ultrasound array only using a single data acquisition (DAQ) channel. To reduce the channel number of DAQ, we superimpose 30 nearby channels' signals together in the analog domain, and shrinking to 4 channels of data (120/30=4). Furthermore, a four-to-one delay-line module is designed to combine these four channels' data into one channel before entering the sin…
Photoacoustic computed tomography (PACT) is an emerging computed imaging modality that exploits optical contrast and ultrasonic detection principles to form images of the absorbed optical energy density within tissue. When the imaging system employs conventional piezoelectric ultrasonic transducers, the ideal photoacoustic (PA) signals are degraded by the transducers' acousto-electric impulse responses (EIRs) during the measurement process. If unaccounted for, this can degrade the accuracy of the reconstructed image. In principle, the effect of the EIRs on the measured PA signals can be amelio…
Fully three-dimensional sound speed-corrected multi-wavelength photoacoustic breast tomography
University of Twente（特温特大学）；Centrum Wiskunde & Informatica（数学与计算机科学中心）；University College London（伦敦大学学院）；Medisch Spectrum Twente Hospital（特温特医学频谱医院）；P.A. Imaging R&D B.V.；Brno University of Technology（布尔诺理工大学）；Imasonic SAS；Ekspla UAB；Leiden University Medical Center（莱顿大学医学中心）；Center for Physical Science and Technology（物理科学与技术中心）；Ziekenhuisgroep Twente（特温特医院集团）
The penetration depth of photoacoustic imaging in biological tissues has been fundamentally limited by the strong optical attenuation when light is delivered externally through the tissue surface. To address this issue, we previously reported internal-illumination photoacoustic imaging using a customized radial-emission optical fiber diffuser, which, however, has complex fabrication, high cost, and non-uniform light emission. To overcome these shortcomings, we have developed a new type of low-cost fiber diffusers based on a graded-scattering method in which the optical scattering of the fiber …
Photoacoustic imaging has proven to be able to detect vascularization-driven optical absorption contrast associated with tumors. In order to detect breast tumors located a few centimeter deep in tissue, a sensitive ultrasound detector is of crucial importance for photoacoustic mammography. Further, because the expected photoacoustic frequency bandwidth (a few MHz to tens of kHz) is inversely proportional to the dimensions of light absorbing structures (0.5 to 10+ mm), proper choices of materials and their geometries, and proper considerations in design have to be made for optimal photoacoustic…
A New Sparsification and Reconstruction Strategy for Compressed Sensing Photoacoustic Tomography
Christian Doppler Laboratory for Photoacoustic Imaging and Laser Ultrasonics（光声成像和激光超声学 Christian Doppler 实验室）；Research Center for Non-Destructive Testing (RECENDT)（无损检测研究中心 (RECENDT)）；Department of Mathematics, University of Idaho（爱达荷大学数学系）
In linear-array transducer based photoacoustic (PA) imaging, B-scan PA images are formed using the raw channel PA signals. Delay-and-Sum (DAS) is the most prevalent algorithm due to its simple implementation, but it leads to low quality images. Delay-Multiply-and-Sum (DMAS) provides a higher image quality in comparison with DAS while it imposes a computational burden of O(M^2). In this work, we introduce a nonlinear (NL) beamformer for linear-array PA imaging, which uses the p^{th} root of the detected signals and imposes the complexity of DAS (O(M)). The proposed algorithm is evaluated numeri…
University of Oulu（奥卢大学）；University College London（伦敦大学学院）
Biomedical photoacoustic tomography, which can provide high resolution 3D soft tissue images based on the optical absorption, has advanced to the stage at which translation from the laboratory to clinical settings is becoming possible. The need for rapid image formation and the practical restrictions on data acquisition that arise from the constraints of a clinical workflow are presenting new image reconstruction challenges. There are many classical approaches to image reconstruction, but ameliorating the effects of incomplete or imperfect data through the incorporation of accurate priors is c…
Photoacoustic computed tomography (PACT) is an emerging computed imaging modality that exploits optical contrast and ultrasonic detection principles to form images of the absorbed optical energy density within tissue. If the object possesses spatially variant acoustic properties that are unaccounted for by the reconstruction method, the estimated image can contain distortions. While reconstruction methods have recently been developed to compensate for this effect, they generally require the object's acoustic properties to be known a priori. To circumvent the need for detailed information regar…
Photoacoustic computed tomography (PACT) detects light-induced ultrasound waves to reconstruct the optical absorption contrast of the biological tissues. Due to its relatively deep penetration (several centimeters in soft tissue), high spatial resolution, and inherent functional sensitivity, PACT has great potential for imaging mouse brains with endogenous and exogenous contrasts, which is of immense interest to the neuroscience community. However, conventional PACT either assumes homogenous optical fluence within the brain or uses a simplified attenuation model for optical fluence estimation.…
German Cancer Research Center (DKFZ)（德国癌症研究中心（DKFZ））；Heidelberg University（海德堡大学）；Heidelberg University Hospital（海德堡大学医院）
Purpose: Photoacoustic tomography (PAT) is a novel imaging technique that can spatially resolve both morphological and functional tissue properties, such as the vessel topology and tissue oxygenation. While this capacity makes PAT a promising modality for the diagnosis, treatment and follow-up of various diseases, a current drawback is the limited field-of-view (FoV) provided by the conventionally applied 2D probes. Methods: In this paper, we present a novel approach to 3D reconstruction of PAT data (Tattoo tomography) that does not require an external tracking system and can smoothly be integ…
Revisiting the joint estimation of initial pressure and speed-of-sound distributions in photoacoustic computed tomography with consideration of canonical object constraints
