X-ray single particle imaging involves the measurement of a large number of noisy diffraction patterns of isolated objects in random orientations. The missing information about these patterns is then computationally recovered in order to obtain a three-dimensional structure of the particle. While the method has promised to deliver room temperature structures at near-atomic resolution, there have been significant experimental hurdles in collecting data of sufficient quality and quantity to achieve this goal. This paper describes two ways to modify the conventional methodology which significantly ease the experimental challenges, at the cost of additional computational complexity in the reconstruction procedure. Both these methods involve the use of holographic reference objects in close proximity to the sample of interest, whose structure can be described with only a few parameters. A reconstruction algorithm to recover the unknown degrees of freedom is also proposed and tested with toy-model simulations.
Wavefront sensing and reconstruction are widely used for adaptive optics, aberration correction, and high-resolution optical phase imaging. Traditionally, interference and/or microlens arrays are used to convert the optical phase into intensity variation. Direct imaging of distorted wavefront usually results in complicated phase retrieval with low contrast and low sensitivity. Here, a novel approach has been developed and experimentally demonstrated based on the phase-sensitive information encoded into second harmonic signals, which are intrinsically sensitive to wavefront modulations. By desi…
Stanford University（斯坦福大学）；SLAC National Accelerator Laboratory（SLAC国家加速器实验室）
A new reference design is introduced for holographic coherent diffraction imaging. This consists in two references - "block" and "pinhole" shaped regions - placed adjacent to the imaging specimen. An efficient recovery algorithm is provided for the resulting holographic phase retrieval problem, which is based on solving a structured, overdetermined linear system. Analysis of the expected recovery error on noisy data, which is contaminated by Poisson shot noise, shows that this simple modification synergizes the individual references and hence leads to uniformly superior performance over single…
Ghost imaging (GI) is an intriguing imaging technology which achieves the object images through intensity correlation between reference patterns and bucket signal. Here, we propose a probability model to explain the imaging mechanism of this modality, by assuming that the reference patterns fulfill an arbitrary identical distribution and that the objects are of gray-scale. We have proven that the probability of the reconstructed pixel values in the pixel region of the same original gray value obeys a Gaussian distribution, no matter which functional form of the reference patterns is used in co…
Correlated photon pairs, carrying strong quantum correlations, have been harnessed to bring quantum advantages to various fields from biological imaging to range finding. Such inherent non-classical properties support extracting more valid signals to build photon-limited images even in low flux-level, where the shot noise becomes dominant as light source decreases to single-photon level. Optimization by numerical reconstruction algorithms is possible but require thousands of photon-sparse frames, thus unavailable in real time. Here, we present an experimental fast correlated-photon imaging enh…
Spatial resolution in optical microscopy has traditionally been treated as a fixed parameter of the optical system. Here, we present an approach to enhance transverse resolution in beam-scanned optical coherence tomography (OCT) beyond its aberration-free resolution limit, without any modification to the optical system. Based on the theorem of invariance of information capacity, resolution-enhanced (RE)-OCT navigates the exchange of information between resolution and signal-to-noise ratio (SNR) by exploiting efficient noise suppression via coherent averaging and a simple computational bandwidt…
Universitat de Barcelona（巴塞罗那大学）；Hospital de la Santa Creu i Sant Pau（圣十字圣保罗医院）；Universitat Autònoma de Barcelona（巴塞罗那自治大学）；Hospital Universitari Vall d’Hebron（瓦尔德希伯伦大学医院）
The domain generalization problem has been widely investigated in deep learning for non-contrast imaging over the last years, but it received limited attention for contrast-enhanced imaging. However, there are marked differences in contrast imaging protocols across clinical centers, in particular in the time between contrast injection and image acquisition, while access to multi-center contrast-enhanced image data is limited compared to available datasets for non-contrast imaging. This calls for new tools for generalizing single-domain, single-center deep learning models across new unseen doma…
Traditional radar imaging methods suffer from the problems of low resolution and poor noise suppression. We propose a new radar imaging method based on Self-supervised deep-learning-assisted compressed sensing (SS-DL-CS-Net). The original radar image as the input of net. The net is trained to learn the mapping function between the original radar image and the high quality radar image. However, the high quality radar image cant be obtained. We solve this problem by used the sparsity of radar image. The original radar image and image with the zeros value as the reference of net. Ours net dont ne…
Interferometric speckle visibility spectroscopy (iSVS) for measuring decorrelation time and dynamics of moving samples with enhanced signal-to-noise ratio and relaxed reference requirements
In this work we examine the performance enhancement in classification of medical imaging data when image features are combined with associated non-image data. We compare the performance of eight state-of-the-art deep neural networks in classification tasks when using only image features, compared to when these are combined with patient metadata. We utilise transfer learning with networks pretrained on ImageNet used directly as feature extractors and fine tuned on the target domain. Our experiments show that performance can be significantly enhanced with the inclusion of metadata and use interp…
Charles Stark Draper Laboratory（查尔斯·斯塔克·德拉普尔实验室）；Stanford Medicine（斯坦福医学）；Bracco Diagnostics Corporation（布拉科诊断公司）
Molecularly targeted contrast enhanced ultrasound (mCEUS) is a clinically promising approach for early cancer detection through targeted imaging of VEGFR2 (KDR) receptors. We have developed computational enhancement techniques for mCEUS tailored to address the unique challenges of imaging contrast accumulation in humans. These techniques utilize dynamic analysis to distinguish molecularly bound contrast agent from other contrast-mode signal sources, enabling analysis of contrast agent accumulation to be performed during contrast bolus arrival when the signal due to molecular binding is stronge…
Quantification of cardiac structures in non-contrast CT (NCCT) could improve cardiovascular risk stratification. However, setting a manual reference to train a fully convolutional network (FCN) for automatic segmentation of NCCT images is hardly feasible, and an FCN trained on coronary CT angiography (CCTA) images would not generalize to NCCT. Therefore, we propose to train an FCN with virtual non-contrast (VNC) images from a dual-layer detector CT scanner and a reference standard obtained on perfectly aligned CCTA images.
Department of Bioengineering, Imperial College London（帝国理工学院生物工程系）；Cardiovascular Magnetic Resonance Unit, Royal Brompton Hospital（皇家布里托尼医院心血管磁共振单位）；National Heart and Lung Institute, Imperial College London（帝国理工学院国家心脏和肺研究所）
PAII Inc.（PAII 公司）；Shengjing Hospital of China Medical University（中国医科大学附属盛京医院）；Ping An Technology（平安科技）
Pancreatic ductal adenocarcinoma (PDAC) is one of the most lethal cancers and carries a dismal prognosis. Surgery remains the best chance of a potential cure for patients who are eligible for initial resection of PDAC. However, outcomes vary significantly even among the resected patients of the same stage and received similar treatments. Accurate preoperative prognosis of resectable PDACs for personalized treatment is thus highly desired. Nevertheless, there are no automated methods yet to fully exploit the contrast-enhanced computed tomography (CE-CT) imaging for PDAC. Tumor attenuation chang…
In a standard computed tomography (CT) image, pixels having the same Hounsfield Units (HU) can correspond to different materials and it is therefore challenging to differentiate and quantify materials. Dual-energy CT (DECT) is desirable to differentiate multiple materials, but DECT scanners are not widely available as single-energy CT (SECT) scanners. Here we purpose a deep learning approach to perform DECT imaging by using standard SECT data. We designed a predenoising and difference learning mechanism to generate DECT images from SECT data. The performance of the deep learning-based DECT app…
Northwestern Polytechnical University（西北工业大学）；China Telecom（中国电信）；Friedrich Schiller University（弗里德里希·席勒大学）；Helmholtz Institute Jena（耶拿亥姆霍兹研究所）；Shanghai Institute of Optics and Fine Mechanics（上海光学精密机械研究所）；University of Chinese Academy of Sciences（中国科学院大学）
Inverse Problem Approach to Aberration Correction for in vivo Transcranial Imaging Based on a Sparse Representation of Contrast-enhanced Ultrasound Data
The American University in Cairo（开罗美国大学）；Aswan Heart Centre（阿斯旺心脏中心）
In this paper, we propose an enhanced 3D myocardial strain estimation procedure, which combines complementary displacement information from multiple orientations of a single imaging modality (untagged CMR SSFP images). To estimate myocardial strain across the left ventricle, we register the sets of short-axis, four-chamber and two-chamber views via a 2D non-rigid registration algorithm implemented in a commercial software (Segment, Medviso). We then create a series of interpolating functions for the three orthogonal directions of motion and use them to deform a tetrahedral mesh representation …
Deep transfer learning using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) has shown strong predictive power in characterization of breast lesions. However, pretrained convolutional neural networks (CNNs) require 2D inputs, limiting the ability to exploit the rich 4D (volumetric and temporal) image information inherent in DCE-MRI that is clinically valuable for lesion assessment. Training 3D CNNs from scratch, a common method to utilize high-dimensional information in medical images, is computationally expensive and is not best suited for moderately sized healthcare datasets. …
