Deep learning methods can be found in many medical imaging applications. Recently, those methods were applied directly to the RF ultrasound multi-channel data to enhance the quality of the reconstructed images. In this paper, we apply a deep neural network to medical ultrasound imaging in the beamforming stage. Specifically, we train the network using simulated multi-channel data from two arrays with different sizes, using a variety of direction of arrival (DOA) angles, and test its generalization performance on real cardiac data. We demonstrate that our method can be used to improve image quality over standard methods, both in terms of resolution and contrast. Alternatively, it can be used to reduce the number of elements in the array, while maintaining the image quality. The utility of our method is demonstrated on both simulated and real data.
Biomedical imaging is unequivocally dependent on the ability to reconstruct interpretable and high-quality images from acquired sensor data. This reconstruction process is pivotal across many applications, spanning from magnetic resonance imaging to ultrasound imaging. While advanced data-adaptive reconstruction methods can recover much higher image quality than traditional approaches, their implementation often poses a high computational burden. In ultrasound imaging, this burden is significant, especially when striving for low-cost systems, and has motivated the development of high-resolutio…
Real-time three dimensional (3D) ultrasound provides complete visualization of inner body organs and blood vasculature, which is crucial for diagnosis and treatment of diverse diseases. However, 3D systems require massive hardware due to the huge number of transducer elements and consequent data size. This increases cost significantly and limits both frame rate and image quality, thus preventing 3D ultrasound from being common practice in clinics worldwide. A recent study proposed a technique, called convolutional beamforming algorithm (COBA), which obtains improved image quality while allowin…
In Ultrasound (US) imaging, Delay and Sum (DAS) is the most common beamformer, but it leads to low quality images. Delay Multiply and Sum (DMAS) was introduced to address this problem. However, the reconstructed images using DMAS still suffer from level of sidelobes and low noise suppression. In this paper, a novel beamforming algorithm is introduced based on the expansion of DMAS formula. It is shown that there is a DAS algebra inside the expansion, and it is proposed to use DMAS instead of the DAS algebra. The introduced method, namely Double Stage DMAS (DS-DMAS), is evaluated numerically an…
Ultrasound B-Mode images are created from data obtained from each element in the transducer array in a process called beamforming. The beamforming goal is to enhance signals from specified spatial locations, while reducing signal from all other locations. On clinical systems, beamforming is accomplished with the delay-and-sum (DAS) algorithm. DAS is efficient but fails in patients with high noise levels, so various adaptive beamformers have been proposed. Recently, deep learning methods have been developed for this task. With deep learning methods, beamforming is typically framed as a regressi…
Diagnostic imaging plays a critical role in healthcare, serving as a fundamental asset for timely diagnosis, disease staging and management as well as for treatment choice, planning, guidance, and follow-up. Among the diagnostic imaging options, ultrasound imaging is uniquely positioned, being a highly cost-effective modality that offers the clinician an unmatched and invaluable level of interaction, enabled by its real-time nature. Ultrasound probes are becoming increasingly compact and portable, with the market demand for low-cost pocket-sized and (in-body) miniaturized devices expanding. At…
In the medical fields, ultrasound detection is often performed with piezoelectric arrays that enable one to simultaneously map the acoustic fields at several positions. In this work, we develop a novel method for transforming a single-element ultrasound detector into an effective detection array by spatially filtering the incoming acoustic fields using a binary acoustic mask coded with cyclic Hadamard patterns. By scanning the mask in front of the detector, we obtain a multiplexed measurement dataset from which a map of the acoustic field is analytically constructed. We experimentally demonstr…
In the recent past, there have been many efforts to accelerate adaptive beamforming for ultrasound (US) imaging using neural networks (NNs). However, most of these efforts are based on static models, i.e., they are trained to learn a single adaptive beamforming approach (e.g., minimum variance distortionless response (MVDR)) assuming that they result in the best image quality. Moreover, the training of such NNs is initiated only after acquiring a large set of data that consumes several gigabytes (GBs) of storage space. In this study, an active learning framework for beamforming is described fo…
Wireless ultrasound (US) systems that produce high-quality images can improve current clinical diagnosis capabilities by making the imaging process much more efficient, affordable, and accessible to users. The most common technique for generating B-mode US images is delay and sum (DAS) beamforming, where an appropriate delay is introduced to signals sampled and processed at each transducer element. However, sampling rates that are much higher than the Nyquist rate of the signal are required for high resolution DAS beamforming, leading to large amounts of data, making transmission of channel da…
Implicit Neural Representation for Multiuser Continuous Aperture Array Beamforming
School of Electronics and Information Engineering, Beihang University（北京航空航天大学电子信息工程学院）；School of Electronic Engineering and Computer Science, Queen Mary University of London（伦敦大学玛丽女王学院电子工程与计算机科学学院）
Three-dimensional (3D) ultrasound (US) imaging addresses the limitation in field-of-view (FOV) in conventional two-dimensional (2D) US imaging by providing 3D viewing of the anatomy. 3D US imaging has been extensively adapted for diagnosis and image-guided surgical intervention. However, conventional approaches to implement 3D US imaging require either expensive and sophisticated 2D array transducers, or external actuation mechanisms to move a one-dimensional array mechanically. Here, we propose a 3D US imaging mechanism using actuated acoustic reflector instead of the sensor elements for volu…
Typically, an ultrasound flow imaging system employs the conventional delay and sum (DAS) beamformer due to its inherent low complexity. But the conventional DAS technique offers poor contrast, low imaging resolution, and limited spatiotemporal sensitivity. This article attempts to improve the spatiotemporal sensitivity of conventional flow imaging with a novel multiply and sum based nonlinear high-resolution (NLHR) beamforming approach. The major advantages of the proposed beamformer are the harmonic generation and the enhanced coherence in beamformed signals that improve the spatiotemporal s…
In the case of vector flow imaging systems, the most employed flow estimation techniques are the directional beamforming based cross correlation and the triangulation-based autocorrelation. However, the directional beamforming-based techniques require an additional angle estimator and are not reliable if the flow angle is not constant throughout the region of interest. On the other hand, estimates with triangulation-based techniques are prone to large bias and variance at low imaging depths due to limited angle for left and right apertures. In view of this, a novel angle independent depth awar…
Improving the Elevational Focusing of Fast Orthogonal Row-Column Electronic Scanning (FORCES) Ultrasound Imaging using Retrospective Transmit Beamforming (RTB)
Row-column arrays have shown to be able to generate 3-D ultrafast ultrasound images with an order of magnitude less independent electronic channels than classic 2D matrix arrays. Unfortunately row-column array images suffer from major imaging artefacts due to the high side lobes. This paper proposes a row-column specific beamforming technique that exploits the incoherent nature of certain row column array artefacts. The geometric mean of the data from each row and column pair is taken prior to summation in beamforming, thus drastically reducing incoherent imaging artefacts compared to traditio…
For beamforming ultrasound (US) signals, typically a spatially constant speed-of-sound (SoS) is assumed to calculate delays. As SoS in tissue may vary relatively largely, this approximation may cause wavefront aberrations, thus degrading effective imaging resolution. In the literature, corrections have been proposed based on unidirectional SoS estimation or computationally-expensive a posteriori phase rectification. In this paper we demonstrate a direct delay correction approach for US beamforming, by leveraging 2D spatial SoS distribution estimates from plane-wave imaging. We show both in sim…
We develop sparse array receive beamformer design methods achieving maximum signal-to-interference plus noise ratio (MaxSINR) for wideband sources and jammers. Both tapped delay line (TDL) filtering and the DFT realizations to wideband array processing are considered. The array sparsity stems from the limited number of available RF transmission chains that switch between the sensors, thereby configuring different arrays at different times. The sparse array configuration design problem is formulated as a quadratically constraint quadratic program (QCQP) and solved by using SDR (semidefinite rel…
Reconfigurable intelligent surface (RIS) can improve the communications between a source and a destination. Recently, continuous aperture RIS is proved to have better communication performance than discrete aperture RIS and has received much attention. However, the conventional continuous aperture RIS is designed to convert the incoming planar waves into the outgoing planar waves, which is not the optimal reflecting scheme when the receiver is not a planar array and is located in the near field of the RIS. In this paper, we consider two types of receivers in the radiating near field of the RIS…
The ultimate goal of this work is a real-time processing framework for ultrasound image reconstruction augmented with machine learning. To attain this, we have implemented WaveFlow - a set of ultrasound data acquisition and processing tools for TensorFlow. WaveFlow includes: ultrasound Environments (connection points between the input raw ultrasound data source and TensorFlow) and signal processing Operators (ops) library. Raw data can be processed in real-time using algorithms available both in TensorFlow and WaveFlow. Currently, WaveFlow provides ops for B-mode image reconstruction (beamform…
This paper studies analog beamforming in active sensing applications, such as millimeter-wave radar or ultrasound imaging. Analog beamforming architectures employ a single RF-IF chain connected to all array elements via inexpensive phase shifters. This can drastically lower costs compared to fully-digital beamformers having a dedicated RF-IF chain for each sensor. However, controlling only the element phases may lead to elevated side-lobe levels and degraded image quality. We address this issue by image addition, which synthesizes a high resolution image by adding together several lower resolu…
Automatic learning algorithms for improving the image quality of diagnostic B-mode ultrasound (US) images have been gaining popularity in the recent past. In this work, a novel convolutional neural network (CNN) is trained using time of flight corrected in-vivo receiver data of plane wave transmit to produce corresponding high-quality minimum variance distortion less response (MVDR) beamformed image. A comprehensive performance comparison in terms of qualitative and quantitative measures for fully connected neural network (FCNN), the proposed CNN architecture, MVDR and Delay and Sum (DAS) usin…
This paper studies hybrid beamforming for active sensing applications, such as millimeter-wave or ultrasound imaging. Hybrid beamforming can substantially lower the cost and power consumption of fully digital sensor arrays by reducing the number of active front ends. Sparse arrays can be used to further reduce hardware costs. We consider phased arrays and employ linear beamforming with possibly sparse array configurations at both the transmitter and receiver. The quality of the acquired images is improved by adding together several component images corresponding to different transmissions and …
In ultrasound nondestructive testing, a widespread approach is to take synthetic aperture measurements from the surface of a specimen to detect and locate defects within it. Based on these measurements, imaging is usually performed using the Synthetic Aperture Focusing Technique (SAFT). However, SAFT is sub-optimal in terms of resolution and requires oversampling in time domain to obtain a fine grid for the Delay-and-Sum (DAS). On the other hand, parametric reconstruction algorithms give better resolution, but their usage for imaging becomes computationally expensive due to the size of the par…
The most common technique for generating B-mode ultrasound (US) images is delay and sum (DAS) beamforming, where the signals received at the transducer array are sampled before an appropriate delay is applied. This necessitates sampling rates exceeding the Nyquist rate and the use of a large number of antenna elements to ensure sufficient image quality. Recently we proposed methods to reduce the sampling rate and the array size relying on image recovery using iterative algorithms, based on compressed sensing (CS) and the finite rate of innovation (FRI) frameworks. Iterative algorithms typicall…
Super-Resolution Ultrasound (SRUS) through localizing spatially isolated microbubbles has been demonstrated to overcome the wave diffraction limit and reveal the microvascular structure and flow information at the microscopic scale. However, 3D SRUS imaging remains a challenge due to the fabrication and computational complexity of 2D matrix array probes and connections. Inspired by X-ray radiography which can present volumetric information in a single projection image with much simpler hardware than X-ray CT, this study investigates the feasibility of volumetric image projection super-resoluti…
Background and Objective: Computational ultrasound imaging has become a well-established methodology in the ultrasound community. Simulations of ultrasound sequences and images allow the study of innovative techniques in terms of emission strategy, beamforming, and probe design. There is a wide spectrum of software dedicated to ultrasound imaging, each having its specificities in its applications and the numerical method. Methods: We describe in this two-part paper a new ultrasound simulator (SIMUS) for MATLAB, which belongs to the MATLAB UltraSound Toolbox (MUST). The SIMUS software simulates…
Eindhoven University of Technology（埃因霍温理工大学）；Technion（以色列理工学院）；Weizmann Institute of Science（魏茨曼科学研究所）
We consider deep learning strategies in ultrasound systems, from the front-end to advanced applications. Our goal is to provide the reader with a broad understanding of the possible impact of deep learning methodologies on many aspects of ultrasound imaging. In particular, we discuss methods that lie at the interface of signal acquisition and machine learning, exploiting both data structure (e.g. sparsity in some domain) and data dimensionality (big data) already at the raw radio-frequency channel stage. As some examples, we outline efficient and effective deep learning solutions for adaptive …
Integrated photonic active beamforming can significantly reduce the size and cost of coherent imagers for LiDAR and medical imaging applications. In current architectures, the complexity of photonic and electronic circuitry linearly increases with the desired imaging resolution. We propose a novel photonic transceiver architecture based on co-prime sampling techniques that breaks this trade-off and achieves the full (radiating-element-limited) field-of-view (FOV) for a 2D aperture with a single-frequency laser. Using only order-of-N radiating elements, this architecture achieves beamwidth and …
In recent years, the minimum variance (MV) beamforming has been widely studied due to its high resolution and contrast in B-mode Ultrasound imaging (USI). However, the performance of the MV beamformer is degraded at the presence of noise, as a result of the inaccurate covariance matrix estimation which leads to a low quality image. Second harmonic imaging (SHI) provides many advantages over the conventional pulse-echo USI, such as enhanced axial and lateral resolutions. However, the low signal-to-noise ratio (SNR) is a major problem in SHI. In this paper, Eigenspace-based minimum variance (EIB…
