Ultrasound B-Mode images are created from data obtained from each element in the transducer array in a process called beamforming. The beamforming goal is to enhance signals from specified spatial locations, while reducing signal from all other locations. On clinical systems, beamforming is accomplished with the delay-and-sum (DAS) algorithm. DAS is efficient but fails in patients with high noise levels, so various adaptive beamformers have been proposed. Recently, deep learning methods have been developed for this task. With deep learning methods, beamforming is typically framed as a regression problem, where clean, ground-truth data is known, and usually simulated. For in vivo data, however, it is extremely difficult to collect ground truth information, and deep networks trained on simulated data underperform when applied to in vivo data, due to domain shift between simulated and in vivo data. In this work, we show how to correct for domain shift by learning deep network beamformers that leverage both simulated data, and unlabeled in vivo data, via a novel domain adaption scheme. A challenge in our scenario is that domain shift exists both for noisy input, and clean output. We address this challenge by extending cycle-consistent generative adversarial networks, where we leverage maps between synthetic simulation and real in vivo domains to ensure that the learned beamformers capture the distribution of both noisy and clean in vivo data. We obtain consistent in vivo image quality improvements compared to existing beamforming techniques, when applying our approach to simulated anechoic cysts and in vivo liver data.
Deep learning methods can be found in many medical imaging applications. Recently, those methods were applied directly to the RF ultrasound multi-channel data to enhance the quality of the reconstructed images. In this paper, we apply a deep neural network to medical ultrasound imaging in the beamforming stage. Specifically, we train the network using simulated multi-channel data from two arrays with different sizes, using a variety of direction of arrival (DOA) angles, and test its generalization performance on real cardiac data. We demonstrate that our method can be used to improve image qua…
Biomedical imaging is unequivocally dependent on the ability to reconstruct interpretable and high-quality images from acquired sensor data. This reconstruction process is pivotal across many applications, spanning from magnetic resonance imaging to ultrasound imaging. While advanced data-adaptive reconstruction methods can recover much higher image quality than traditional approaches, their implementation often poses a high computational burden. In ultrasound imaging, this burden is significant, especially when striving for low-cost systems, and has motivated the development of high-resolutio…
Real-time three dimensional (3D) ultrasound provides complete visualization of inner body organs and blood vasculature, which is crucial for diagnosis and treatment of diverse diseases. However, 3D systems require massive hardware due to the huge number of transducer elements and consequent data size. This increases cost significantly and limits both frame rate and image quality, thus preventing 3D ultrasound from being common practice in clinics worldwide. A recent study proposed a technique, called convolutional beamforming algorithm (COBA), which obtains improved image quality while allowin…
In Ultrasound (US) imaging, Delay and Sum (DAS) is the most common beamformer, but it leads to low quality images. Delay Multiply and Sum (DMAS) was introduced to address this problem. However, the reconstructed images using DMAS still suffer from level of sidelobes and low noise suppression. In this paper, a novel beamforming algorithm is introduced based on the expansion of DMAS formula. It is shown that there is a DAS algebra inside the expansion, and it is proposed to use DMAS instead of the DAS algebra. The introduced method, namely Double Stage DMAS (DS-DMAS), is evaluated numerically an…
Diagnostic imaging plays a critical role in healthcare, serving as a fundamental asset for timely diagnosis, disease staging and management as well as for treatment choice, planning, guidance, and follow-up. Among the diagnostic imaging options, ultrasound imaging is uniquely positioned, being a highly cost-effective modality that offers the clinician an unmatched and invaluable level of interaction, enabled by its real-time nature. Ultrasound probes are becoming increasingly compact and portable, with the market demand for low-cost pocket-sized and (in-body) miniaturized devices expanding. At…
In the recent past, there have been many efforts to accelerate adaptive beamforming for ultrasound (US) imaging using neural networks (NNs). However, most of these efforts are based on static models, i.e., they are trained to learn a single adaptive beamforming approach (e.g., minimum variance distortionless response (MVDR)) assuming that they result in the best image quality. Moreover, the training of such NNs is initiated only after acquiring a large set of data that consumes several gigabytes (GBs) of storage space. In this study, an active learning framework for beamforming is described fo…
Wireless ultrasound (US) systems that produce high-quality images can improve current clinical diagnosis capabilities by making the imaging process much more efficient, affordable, and accessible to users. The most common technique for generating B-mode US images is delay and sum (DAS) beamforming, where an appropriate delay is introduced to signals sampled and processed at each transducer element. However, sampling rates that are much higher than the Nyquist rate of the signal are required for high resolution DAS beamforming, leading to large amounts of data, making transmission of channel da…
Typically, an ultrasound flow imaging system employs the conventional delay and sum (DAS) beamformer due to its inherent low complexity. But the conventional DAS technique offers poor contrast, low imaging resolution, and limited spatiotemporal sensitivity. This article attempts to improve the spatiotemporal sensitivity of conventional flow imaging with a novel multiply and sum based nonlinear high-resolution (NLHR) beamforming approach. The major advantages of the proposed beamformer are the harmonic generation and the enhanced coherence in beamformed signals that improve the spatiotemporal s…
In the case of vector flow imaging systems, the most employed flow estimation techniques are the directional beamforming based cross correlation and the triangulation-based autocorrelation. However, the directional beamforming-based techniques require an additional angle estimator and are not reliable if the flow angle is not constant throughout the region of interest. On the other hand, estimates with triangulation-based techniques are prone to large bias and variance at low imaging depths due to limited angle for left and right apertures. In view of this, a novel angle independent depth awar…
Improving the Elevational Focusing of Fast Orthogonal Row-Column Electronic Scanning (FORCES) Ultrasound Imaging using Retrospective Transmit Beamforming (RTB)
For beamforming ultrasound (US) signals, typically a spatially constant speed-of-sound (SoS) is assumed to calculate delays. As SoS in tissue may vary relatively largely, this approximation may cause wavefront aberrations, thus degrading effective imaging resolution. In the literature, corrections have been proposed based on unidirectional SoS estimation or computationally-expensive a posteriori phase rectification. In this paper we demonstrate a direct delay correction approach for US beamforming, by leveraging 2D spatial SoS distribution estimates from plane-wave imaging. We show both in sim…
The ultimate goal of this work is a real-time processing framework for ultrasound image reconstruction augmented with machine learning. To attain this, we have implemented WaveFlow - a set of ultrasound data acquisition and processing tools for TensorFlow. WaveFlow includes: ultrasound Environments (connection points between the input raw ultrasound data source and TensorFlow) and signal processing Operators (ops) library. Raw data can be processed in real-time using algorithms available both in TensorFlow and WaveFlow. Currently, WaveFlow provides ops for B-mode image reconstruction (beamform…
Automatic learning algorithms for improving the image quality of diagnostic B-mode ultrasound (US) images have been gaining popularity in the recent past. In this work, a novel convolutional neural network (CNN) is trained using time of flight corrected in-vivo receiver data of plane wave transmit to produce corresponding high-quality minimum variance distortion less response (MVDR) beamformed image. A comprehensive performance comparison in terms of qualitative and quantitative measures for fully connected neural network (FCNN), the proposed CNN architecture, MVDR and Delay and Sum (DAS) usin…
Adaptive beamforming can lead to substantial improvement in resolution and contrast of ultrasound images over standard delay and sum beamforming. Here we introduce the adaptive time-channel (ATC) beamformer, a data-driven approach that combines spatial and temporal information simultaneously, thus generalizing minimum variance beamformers. Moreover, we broaden the concept of apodization to the temporal dimension. Our approach reduces noises by allowing for the weights to adapt in both the temporal and spatial dimensions, thereby reducing artifacts caused by the media's inhomogeneities. We appl…
The most common technique for generating B-mode ultrasound (US) images is delay and sum (DAS) beamforming, where the signals received at the transducer array are sampled before an appropriate delay is applied. This necessitates sampling rates exceeding the Nyquist rate and the use of a large number of antenna elements to ensure sufficient image quality. Recently we proposed methods to reduce the sampling rate and the array size relying on image recovery using iterative algorithms, based on compressed sensing (CS) and the finite rate of innovation (FRI) frameworks. Iterative algorithms typicall…
Eindhoven University of Technology（埃因霍温理工大学）；Technion（以色列理工学院）；Weizmann Institute of Science（魏茨曼科学研究所）
We consider deep learning strategies in ultrasound systems, from the front-end to advanced applications. Our goal is to provide the reader with a broad understanding of the possible impact of deep learning methodologies on many aspects of ultrasound imaging. In particular, we discuss methods that lie at the interface of signal acquisition and machine learning, exploiting both data structure (e.g. sparsity in some domain) and data dimensionality (big data) already at the raw radio-frequency channel stage. As some examples, we outline efficient and effective deep learning solutions for adaptive …
In this paper, adaptive hybrid beamforming methods are proposed for millimeter-wave range massive multiple-input-multiple-output (MIMO) systems considering single carrier wideband transmission in uplink data mode. A statistical analog beamformer is adaptively constructed in slow-time, while the channel is time-varying and erroneously estimated. A recursive filtering approach is proposed, which aims robustness against estimation errors for generalized eigen-beamformer (GEB). Approximated expressions are obtained for channel covariance matrices that decouple angular spread and center angle of mu…
In recent years, the minimum variance (MV) beamforming has been widely studied due to its high resolution and contrast in B-mode Ultrasound imaging (USI). However, the performance of the MV beamformer is degraded at the presence of noise, as a result of the inaccurate covariance matrix estimation which leads to a low quality image. Second harmonic imaging (SHI) provides many advantages over the conventional pulse-echo USI, such as enhanced axial and lateral resolutions. However, the low signal-to-noise ratio (SNR) is a major problem in SHI. In this paper, Eigenspace-based minimum variance (EIB…
Most ultrasound imaging techniques necessitate the fundamental step of converting temporal signals received from transducer elements into a spatial echogenecity map. This beamforming (BF) step requires the knowledge of speed-of-sound (SoS) value in the imaged medium. An incorrect assumption of BF SoS leads to aberration artifacts, not only deteriorating the quality and resolution of conventional brightness mode (B-mode) images, hence limiting their clinical usability, but also impairing other ultrasound modalities such as elastography and spatial SoS reconstructions, which rely on faithfully b…
This paper studies the fast adaptive beamforming for the multiuser multiple-input single-output downlink. Existing deep learning-based approaches assume that training and testing channels follow the same distribution which causes task mismatch, when the testing environment changes. Although meta learning can deal with the task mismatch, it relies on labelled data and incurs high complexity in the pre-training and fine tuning stages. We propose a simple yet effective adaptive framework to solve the mismatch issue, which trains an embedding model as a transferable feature extractor, followed by …
Photoacoustic imaging (PAI) is a promising medical imaging modality providing the spatial resolution of ultrasound (US) imaging and the contrast of pure optical imaging. For linear-array PAI, a beamformer has to be used as the reconstruction algorithm. Delay-and-sum (DAS) is the most prevalent beamforming algorithm in PAI. However, using DAS beamformer leads to low resolution images along with significant effects of the off-axis signals. Coherence factor (CF) is a weighting method in which each pixel of the reconstructed image is weighted, based on the spatial spectrum of the aperture, to impr…
