Real-time three dimensional (3D) ultrasound provides complete visualization of inner body organs and blood vasculature, which is crucial for diagnosis and treatment of diverse diseases. However, 3D systems require massive hardware due to the huge number of transducer elements and consequent data size. This increases cost significantly and limits both frame rate and image quality, thus preventing 3D ultrasound from being common practice in clinics worldwide. A recent study proposed a technique, called convolutional beamforming algorithm (COBA), which obtains improved image quality while allowing notable element reduction. COBA was developed and tested for 2D focused imaging using full and sparse arrays. The later was referred to as sparse COBA (SCOBA). In this paper, we build upon previous work and introduce a nonlinear beamformer for 3D imaging, called COBA-3D, consisting of 2D spatial convolution of the in-phase and quadrature received signals. The proposed technique considers diverging-wave transmission, thus, achieves improved image resolution and contrast compared with standard delay-and-sum beamforming, while enabling high frame rate. Incorporating 2D sparse arrays into our method creates SCOBA-3D: a sparse beamformer which offers significant element reduction and thus allows to perform 3D imaging with the resources typically available for 2D setups. To create 2D thinned arrays, we present a scalable and systematic way to design 2D fractal sparse arrays. The proposed framework paves the way for affordable ultrafast ultrasound devices that perform high-quality 3D imaging, as demonstrated using phantom and ex-vivo data.
Deep learning methods can be found in many medical imaging applications. Recently, those methods were applied directly to the RF ultrasound multi-channel data to enhance the quality of the reconstructed images. In this paper, we apply a deep neural network to medical ultrasound imaging in the beamforming stage. Specifically, we train the network using simulated multi-channel data from two arrays with different sizes, using a variety of direction of arrival (DOA) angles, and test its generalization performance on real cardiac data. We demonstrate that our method can be used to improve image qua…
Biomedical imaging is unequivocally dependent on the ability to reconstruct interpretable and high-quality images from acquired sensor data. This reconstruction process is pivotal across many applications, spanning from magnetic resonance imaging to ultrasound imaging. While advanced data-adaptive reconstruction methods can recover much higher image quality than traditional approaches, their implementation often poses a high computational burden. In ultrasound imaging, this burden is significant, especially when striving for low-cost systems, and has motivated the development of high-resolutio…
In Ultrasound (US) imaging, Delay and Sum (DAS) is the most common beamformer, but it leads to low quality images. Delay Multiply and Sum (DMAS) was introduced to address this problem. However, the reconstructed images using DMAS still suffer from level of sidelobes and low noise suppression. In this paper, a novel beamforming algorithm is introduced based on the expansion of DMAS formula. It is shown that there is a DAS algebra inside the expansion, and it is proposed to use DMAS instead of the DAS algebra. The introduced method, namely Double Stage DMAS (DS-DMAS), is evaluated numerically an…
Ultrasound B-Mode images are created from data obtained from each element in the transducer array in a process called beamforming. The beamforming goal is to enhance signals from specified spatial locations, while reducing signal from all other locations. On clinical systems, beamforming is accomplished with the delay-and-sum (DAS) algorithm. DAS is efficient but fails in patients with high noise levels, so various adaptive beamformers have been proposed. Recently, deep learning methods have been developed for this task. With deep learning methods, beamforming is typically framed as a regressi…
Row-column arrays have shown to be able to generate 3-D ultrafast ultrasound images with an order of magnitude less independent electronic channels than classic 2D matrix arrays. Unfortunately row-column array images suffer from major imaging artefacts due to the high side lobes. This paper proposes a row-column specific beamforming technique that exploits the incoherent nature of certain row column array artefacts. The geometric mean of the data from each row and column pair is taken prior to summation in beamforming, thus drastically reducing incoherent imaging artefacts compared to traditio…
Diagnostic imaging plays a critical role in healthcare, serving as a fundamental asset for timely diagnosis, disease staging and management as well as for treatment choice, planning, guidance, and follow-up. Among the diagnostic imaging options, ultrasound imaging is uniquely positioned, being a highly cost-effective modality that offers the clinician an unmatched and invaluable level of interaction, enabled by its real-time nature. Ultrasound probes are becoming increasingly compact and portable, with the market demand for low-cost pocket-sized and (in-body) miniaturized devices expanding. At…
In the recent past, there have been many efforts to accelerate adaptive beamforming for ultrasound (US) imaging using neural networks (NNs). However, most of these efforts are based on static models, i.e., they are trained to learn a single adaptive beamforming approach (e.g., minimum variance distortionless response (MVDR)) assuming that they result in the best image quality. Moreover, the training of such NNs is initiated only after acquiring a large set of data that consumes several gigabytes (GBs) of storage space. In this study, an active learning framework for beamforming is described fo…
Ultrafast ultrasound imaging remains an active area of interest in the ultrasound community due to its ultra-high frame rates. Recently, a wide variety of studies based on deep learning have sought to improve ultrafast ultrasound imaging. Most of these approaches have been performed on radio frequency (RF) signals. However, inphase/quadrature (I/Q) digital beamformers are now widely used as low-cost strategies. In this work, we used complex convolutional neural networks for reconstruction of ultrasound images from I/Q signals. We recently described a convolutional neural network architecture c…
Wireless ultrasound (US) systems that produce high-quality images can improve current clinical diagnosis capabilities by making the imaging process much more efficient, affordable, and accessible to users. The most common technique for generating B-mode US images is delay and sum (DAS) beamforming, where an appropriate delay is introduced to signals sampled and processed at each transducer element. However, sampling rates that are much higher than the Nyquist rate of the signal are required for high resolution DAS beamforming, leading to large amounts of data, making transmission of channel da…
Typically, an ultrasound flow imaging system employs the conventional delay and sum (DAS) beamformer due to its inherent low complexity. But the conventional DAS technique offers poor contrast, low imaging resolution, and limited spatiotemporal sensitivity. This article attempts to improve the spatiotemporal sensitivity of conventional flow imaging with a novel multiply and sum based nonlinear high-resolution (NLHR) beamforming approach. The major advantages of the proposed beamformer are the harmonic generation and the enhanced coherence in beamformed signals that improve the spatiotemporal s…
In the case of vector flow imaging systems, the most employed flow estimation techniques are the directional beamforming based cross correlation and the triangulation-based autocorrelation. However, the directional beamforming-based techniques require an additional angle estimator and are not reliable if the flow angle is not constant throughout the region of interest. On the other hand, estimates with triangulation-based techniques are prone to large bias and variance at low imaging depths due to limited angle for left and right apertures. In view of this, a novel angle independent depth awar…
Improving the Elevational Focusing of Fast Orthogonal Row-Column Electronic Scanning (FORCES) Ultrasound Imaging using Retrospective Transmit Beamforming (RTB)
Determining the utility of ultrafast nonlinear contrast enhanced and super resolution ultrasound for imaging microcirculation in the human small intestine
For beamforming ultrasound (US) signals, typically a spatially constant speed-of-sound (SoS) is assumed to calculate delays. As SoS in tissue may vary relatively largely, this approximation may cause wavefront aberrations, thus degrading effective imaging resolution. In the literature, corrections have been proposed based on unidirectional SoS estimation or computationally-expensive a posteriori phase rectification. In this paper we demonstrate a direct delay correction approach for US beamforming, by leveraging 2D spatial SoS distribution estimates from plane-wave imaging. We show both in sim…
Three-dimensional (3D) ultrasound (US) imaging addresses the limitation in field-of-view (FOV) in conventional two-dimensional (2D) US imaging by providing 3D viewing of the anatomy. 3D US imaging has been extensively adapted for diagnosis and image-guided surgical intervention. However, conventional approaches to implement 3D US imaging require either expensive and sophisticated 2D array transducers, or external actuation mechanisms to move a one-dimensional array mechanically. Here, we propose a 3D US imaging mechanism using actuated acoustic reflector instead of the sensor elements for volu…
The ultimate goal of this work is a real-time processing framework for ultrasound image reconstruction augmented with machine learning. To attain this, we have implemented WaveFlow - a set of ultrasound data acquisition and processing tools for TensorFlow. WaveFlow includes: ultrasound Environments (connection points between the input raw ultrasound data source and TensorFlow) and signal processing Operators (ops) library. Raw data can be processed in real-time using algorithms available both in TensorFlow and WaveFlow. Currently, WaveFlow provides ops for B-mode image reconstruction (beamform…
This paper studies analog beamforming in active sensing applications, such as millimeter-wave radar or ultrasound imaging. Analog beamforming architectures employ a single RF-IF chain connected to all array elements via inexpensive phase shifters. This can drastically lower costs compared to fully-digital beamformers having a dedicated RF-IF chain for each sensor. However, controlling only the element phases may lead to elevated side-lobe levels and degraded image quality. We address this issue by image addition, which synthesizes a high resolution image by adding together several lower resolu…
Automatic learning algorithms for improving the image quality of diagnostic B-mode ultrasound (US) images have been gaining popularity in the recent past. In this work, a novel convolutional neural network (CNN) is trained using time of flight corrected in-vivo receiver data of plane wave transmit to produce corresponding high-quality minimum variance distortion less response (MVDR) beamformed image. A comprehensive performance comparison in terms of qualitative and quantitative measures for fully connected neural network (FCNN), the proposed CNN architecture, MVDR and Delay and Sum (DAS) usin…
This paper studies hybrid beamforming for active sensing applications, such as millimeter-wave or ultrasound imaging. Hybrid beamforming can substantially lower the cost and power consumption of fully digital sensor arrays by reducing the number of active front ends. Sparse arrays can be used to further reduce hardware costs. We consider phased arrays and employ linear beamforming with possibly sparse array configurations at both the transmitter and receiver. The quality of the acquired images is improved by adding together several component images corresponding to different transmissions and …
The most common technique for generating B-mode ultrasound (US) images is delay and sum (DAS) beamforming, where the signals received at the transducer array are sampled before an appropriate delay is applied. This necessitates sampling rates exceeding the Nyquist rate and the use of a large number of antenna elements to ensure sufficient image quality. Recently we proposed methods to reduce the sampling rate and the array size relying on image recovery using iterative algorithms, based on compressed sensing (CS) and the finite rate of innovation (FRI) frameworks. Iterative algorithms typicall…
Background and Objective: Computational ultrasound imaging has become a well-established methodology in the ultrasound community. Simulations of ultrasound sequences and images allow the study of innovative techniques in terms of emission strategy, beamforming, and probe design. There is a wide spectrum of software dedicated to ultrasound imaging, each having its specificities in its applications and the numerical method. Methods: We describe in this two-part paper a new ultrasound simulator (SIMUS) for MATLAB, which belongs to the MATLAB UltraSound Toolbox (MUST). The SIMUS software simulates…
Eindhoven University of Technology（埃因霍温理工大学）；Technion（以色列理工学院）；Weizmann Institute of Science（魏茨曼科学研究所）
We consider deep learning strategies in ultrasound systems, from the front-end to advanced applications. Our goal is to provide the reader with a broad understanding of the possible impact of deep learning methodologies on many aspects of ultrasound imaging. In particular, we discuss methods that lie at the interface of signal acquisition and machine learning, exploiting both data structure (e.g. sparsity in some domain) and data dimensionality (big data) already at the raw radio-frequency channel stage. As some examples, we outline efficient and effective deep learning solutions for adaptive …
In recent years, the minimum variance (MV) beamforming has been widely studied due to its high resolution and contrast in B-mode Ultrasound imaging (USI). However, the performance of the MV beamformer is degraded at the presence of noise, as a result of the inaccurate covariance matrix estimation which leads to a low quality image. Second harmonic imaging (SHI) provides many advantages over the conventional pulse-echo USI, such as enhanced axial and lateral resolutions. However, the low signal-to-noise ratio (SNR) is a major problem in SHI. In this paper, Eigenspace-based minimum variance (EIB…
Photoacoustic imaging (PAI), is a promising medical imaging technique that provides the high contrast of the optical imaging and the resolution of ultrasound (US) imaging. Among all the methods, Three-dimensional (3D) PAI provides a high resolution and accuracy. One of the most common algorithms for 3D PA image reconstruction is delay-and-sum (DAS). However, the quality of the reconstructed image obtained from this algorithm is not satisfying, having high level of sidelobes and a wide mainlobe. In this paper, delay-multiply-and-sum (DMAS) algorithm is suggested to overcome these limitations in…
Most ultrasound imaging techniques necessitate the fundamental step of converting temporal signals received from transducer elements into a spatial echogenecity map. This beamforming (BF) step requires the knowledge of speed-of-sound (SoS) value in the imaged medium. An incorrect assumption of BF SoS leads to aberration artifacts, not only deteriorating the quality and resolution of conventional brightness mode (B-mode) images, hence limiting their clinical usability, but also impairing other ultrasound modalities such as elastography and spatial SoS reconstructions, which rely on faithfully b…
Deep-Learning Based Super-Resolution Functional Ultrasound Imaging of Transient Brain-Wide Neurovascular Activity on a Microscopic Scale
College of Biomedical Engineering, Fudan University（复旦大学 biomedical 工程学院）；Department of Neurosurgery, Huashan Hospital, Institutes for Translational Brain Research, Fudan University（复旦大学华山医院神经外科、转化脑研究院）；School of Psychology, Institute of Chinese Cultural Psychology, Shanghai Jiao Tong University（上海交通大学心理学学院、中国文化心理研究所）
Delay-and-sum (DAS) is the most widespread digital beamformer in high-frame-rate ultrasound imaging. Its implementation is simple and compatible with real-time applications. In this viewpoint article, we describe the fundamentals of DAS beamforming. The underlying theory and numerical approach are detailed so that users can be aware of its functioning and limitations. In particular, we discuss the importance of the f-number and speed of sound on image quality, and propose one solution to set their values from a physical viewpoint. We suggest determining the f-number from the directivity of the…
Ultrasound imaging provides information from a large part of the muscle. It has recently been shown that ultrafast ultrasound imaging can be used to record and analyze the mechanical response of individual MUs using blind source separation. In this work, we present an alternative method - a deep learning pipeline - to identify active MUs in ultrasound image sequences, including segmentation of their territories and signal estimation of their mechanical responses (twitch train). We train and evaluate the model using simulated data mimicking the complex activation pattern of tens of activated MU…
Ultrafast imaging modes, such as coherent plane-wave compounding (CPWC), capture a large field of view in a single pulse-echo measurement using parallel receive focusing. The number of foci or, equivalently, the number of volume elements (voxels) in the image determines the computational costs and the memory consumption of the image formation. Herein, 120° rhombic grids are proposed to specify the voxel positions and reduce the number of voxels in comparison to orthogonal grids. The proposed grids derive from the bivariate sampling theorem and the spectral properties of the images formed by th…
Photoacoustic imaging (PAI) is a promising medical imaging modality providing the spatial resolution of ultrasound (US) imaging and the contrast of pure optical imaging. For linear-array PAI, a beamformer has to be used as the reconstruction algorithm. Delay-and-sum (DAS) is the most prevalent beamforming algorithm in PAI. However, using DAS beamformer leads to low resolution images along with significant effects of the off-axis signals. Coherence factor (CF) is a weighting method in which each pixel of the reconstructed image is weighted, based on the spatial spectrum of the aperture, to impr…
Photoacoustic imaging (PAI) is an emerging medical imaging modality capable of providing high spatial resolution of Ultrasound (US) imaging and high contrast of optical imaging. Delay-and-Sum (DAS) is the most common beamforming algorithm in PAI. However, using DAS beamformer leads to low resolution images and considerable contribution of off-axis signals. A new paradigm namely Delay-Multiply-and-Sum (DMAS), which was originally used as a reconstruction algorithm in confocal microwave imaging, was introduced to overcome the challenges in DAS. DMAS was used in PAI systems and it was shown that …
Photoacoustic imaging (PAI) is an emerging biomedical imaging modality capable of providing both high contrast and high resolution of optical and UltraSound (US) imaging. When a short duration laser pulse illuminates the tissue as a target of imaging, tissue induces US waves and detected waves can be used to reconstruct optical absorption distribution. Since receiving part of PA consists of US waves, a large number of beamforming algorithms in US imaging can be applied on PA imaging. Delay-and-Sum (DAS) is the most common beamforming algorithm in US imaging. However, make use of DAS beamformer…
Plane wave imaging (PWI) with angular compounding has gained in popularity over recent years because it provides high frame rates and good image properties. However, most linear arrays used in clinical practice have a pitch that is equal to than the wavelength of ultrasound. Hence, the presence of grating lobes is a concern for PWI using multiple transmit angles. The presence of grating lobes produces clutter in images and reduces the ability to observe tissue contrast. Techniques to reduce or eliminate the presence of grating lobes for PWI using multiple angles will result in improved image q…
