Reconstructed 3D ultrasound volume provides more context information compared to a sequence of 2D scanning frames, which is desirable for various clinical applications such as ultrasound-guided prostate biopsy. Nevertheless, 3D volume reconstruction from freehand 2D scans is a very challenging problem, especially without the use of external tracking devices. Recent deep learning based methods demonstrate the potential of directly estimating inter-frame motion between consecutive ultrasound frames. However, such algorithms are specific to particular transducers and scanning trajectories associated with the training data, which may not be generalized to other image acquisition settings. In this paper, we tackle the data acquisition difference as a domain shift problem and propose a novel domain adaptation strategy to adapt deep learning algorithms to data acquired with different transducers. Specifically, feature extractors that generate transducer-invariant features from different datasets are trained by minimizing the discrepancy between deep features of paired samples in a latent space. Our results show that the proposed domain adaptation method can successfully align different feature distributions while preserving the transducer-specific information for universal freehand ultrasound volume reconstruction.
A Skull-Adaptive Framework for AI-Based 3D Transcranial Focused Ultrasound Simulation
University of Strasbourg, CNRS, INSERM, ICube, UMR7357（斯特拉斯堡大学，法国国家科学研究中心，法国国家医学研究院，ICube，UMR7357）；IHU Strasbourg（斯特拉斯堡IHU）；Image Guided Therapy（影像引导治疗）
Indian Institute of Technology Kharagpur（印度理工学院卡拉格布尔分校）
Ultrasound imaging makes use of backscattering of waves during their interaction with scatterers present in biological tissues. Simulation of synthetic ultrasound images is a challenging problem on account of inability to accurately model various factors of which some include intra-/inter scanline interference, transducer to surface coupling, artifacts on transducer elements, inhomogeneous shadowing and nonlinear attenuation. Current approaches typically solve wave space equations making them computationally expensive and slow to operate. We propose a generative adversarial network (GAN) inspi…
Technical University of Munich（慕尼黑工业大学）；Klinikum rechts der Isar（Rechts der Isar 医院）；Johns Hopkins University（约翰斯·霍普金斯大学）
Ultrasound imaging is caught between the quest for the highest image quality, and the necessity for clinical usability. Our contribution is two-fold: First, we propose a novel fully convolutional neural network for ultrasound reconstruction. Second, a custom loss function tailored to the modality is employed for end-to-end training of the network. We demonstrate that training a network to map time-delayed raw data to a minimum variance ground truth offers performance increases in a clinical environment. In doing so, a path is explored towards improved clinically viable ultrasound reconstructio…
Shadow Reduction in Ultrasound Imaging Using Differentiable Simulation and Radiance Field Decomposition
University of Oxford（牛津大学）；University of Amsterdam（阿姆斯特丹大学）；Friedrich-Alexander-Universität Erlangen-Nürnberg（弗里德里希-亚历山大-埃尔朗根-纽伦堡大学）；Imperial College London（伦敦帝国理工学院）；University of Copenhagen（哥本哈根大学）
IRIT UMR CNRS 5505（法国国家科学研究中心IRIT联合研究单元（UMR 5505））；University of Toulouse（图卢兹大学）
The interest of compressive sampling in ultrasound imaging has been recently extensively evaluated by several research teams. Following the different application setups, it has been shown that the RF data may be reconstructed from a small number of measurements and/or using a reduced number of ultrasound pulse emissions. Nevertheless, RF image spatial resolution, contrast and signal to noise ratio are affected by the limited bandwidth of the imaging transducer and the physical phenomenon related to US wave propagation. To overcome these limitations, several deconvolution-based image processing…
Optimization-Based Calibration for Intravascular Ultrasound Volume Reconstruction
Inria；University of Strasbourg（斯特拉斯堡大学）；CNRS（法国国家科学研究中心）；INSERM（法国国家医学研究院）；ICube（ICube研究中心）；UMR7357（UMR7357研究单位）；University of Basel（巴塞尔大学）；Department of Biomedical Engineering（生物医学工程系）；Institute of Image-Guided Surgery（影像引导手术研究所）；IHU Strasbourg（斯特拉斯堡IHU）
University of Toulouse（图卢兹大学）；IRIT CNRS UMR 5505（法国国家科学研究中心IRIT实验室（UMR 5505））
High resolution ultrasound image reconstruction from a reduced number of measurements is of great interest in ultrasound imaging, since it could enhance both the frame rate and image resolution. Compressive deconvolution, combining compressed sensing and image deconvolution, represents an interesting possibility to consider this challenging task. The model of compressive deconvolution includes, in addition to the compressive sampling matrix, a 2D convolution operator carrying the information on the system point spread function. Through this model, the resolution of reconstructed ultrasound ima…
Speed-of-sound is a biomechanical property for quantitative tissue differentiation, with great potential as a new ultrasound-based image modality. A conventional ultrasound array transducer can be used together with an acoustic mirror, or so-called reflector, to reconstruct sound-speed images from time-of-flight measurements to the reflector collected between transducer element pairs, which constitutes a challenging problem of limited-angle computed tomography. For this problem, we herein present a variational network based image reconstruction architecture that is based on optimization loop u…
Technion-Israel Institute of Technology（以色列理工学院）；GE Health-care（通用电气医疗）
Emerging sonography techniques often require increasing the number of transducer elements involved in the imaging process. Consequently, larger amounts of data must be acquired and processed. The significant growth in the amounts of data affects both machinery size and power consumption. Within the classical sampling framework, state of the art systems reduce processing rates by exploiting the bandpass bandwidth of the detected signals. It has been recently shown, that a much more significant sample-rate reduction may be obtained, by treating ultrasound signals within the Finite Rate of Innova…
Multivariate Gaussian NeRF for Wide Field-of-View Ultrasound Reconstruction
Chair for Computer Aided Medical Procedures (CAMP), Technical University of Munich, Germany（计算机辅助医学程序系（CAMP），慕尼黑技术大学，德国）；Munich Center for Machine Learning (MCML), Munich, Germany（慕尼黑机器学习中心，慕尼黑，德国）；LUMA Vision, Beech Hill Road, Dublin, Ireland（LUMA视觉，Beech Hill Road，都柏林，爱尔兰）
ImplicitCell: Resolution Cell Modeling of Joint Implicit Volume Reconstruction and Pose Refinement in Freehand 3D Ultrasound
School of Information Science and Technology, ShanghaiTech University（上海科技大学信息科学与技术学院）；Tongren Hospital, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属同仁医院）
National Research Council Canada（加拿大国家研究委员会）；University of Waterloo（滑铁卢大学）
Besides vaccination, as an effective way to mitigate the further spread of COVID-19, fast and accurate screening of individuals to test for the disease is yet necessary to ensure public health safety. We propose COVID-Net UV, an end-to-end hybrid spatio-temporal deep neural network architecture, to detect COVID-19 infection from lung point-of-care ultrasound videos captured by convex transducers. COVID-Net UV comprises a convolutional neural network that extracts spatial features and a recurrent neural network that learns temporal dependence. After careful hyperparameter tuning, the network ac…
University of Oxford（牛津大学）；Leiden University Medical Center（莱顿大学医学中心）
The objective of this work is to achieve sensorless reconstruction of a 3D volume from a set of 2D freehand ultrasound images with deep implicit representation. In contrast to the conventional way that represents a 3D volume as a discrete voxel grid, we do so by parameterizing it as the zero level-set of a continuous function, i.e. implicitly representing the 3D volume as a mapping from the spatial coordinates to the corresponding intensity values. Our proposed model, termed as ImplicitVol, takes a set of 2D scans and their estimated locations in 3D as input, jointly refining the estimated 3D …
Robot-guided catheter insertion has the potential to deliver urgent medical care in situations where medical personnel are unavailable. However, this technique requires accurate and reliable segmentation of anatomical landmarks in the body. For the ultrasound imaging modality, obtaining large amounts of training data for a segmentation model is time-consuming and expensive. This paper introduces RESUS (RESlicing of UltraSound Images), a weak supervision data augmentation technique for ultrasound images based on slicing reconstructed 3D volumes from tracked 2D images. This technique allows us t…
High-Fidelity Functional Ultrasound Reconstruction via A Visual Auto-Regressive Framework
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（深圳先进技术研究院，中国科学院）；Department of Computer and Information Science, University of Macau（计算机与信息科学系，澳门大学）
Institute of Fundamental Technological Research, Polish Academy of Sciences（波兰科学院基础技术研究所）；Medical University of Warsaw（华沙医科大学）
Convolutional neural networks (CNNs) have achieved remarkable success in medical image analysis tasks. In ultrasound (US) imaging, CNNs have been applied to object classification, image reconstruction and tissue characterization. However, CNNs can be vulnerable to adversarial attacks, even small perturbations applied to input data may significantly affect model performance and result in wrong output. In this work, we devise a novel adversarial attack, specific to ultrasound (US) imaging. US images are reconstructed based on radio-frequency signals. Since the appearance of US images depends on …
RapidVol: Rapid Reconstruction of 3D Ultrasound Volumes from Sensorless 2D Scans
University of Oxford（牛津大学）；Visual Geometry Group, University of Oxford（牛津大学视觉几何组）；Oxford Machine Learning in NeuroImaging Lab, University of Oxford（牛津大学神经影像机器学习实验室）
Freehand 3D ultrasound (US) has important clinical value due to its low cost and unrestricted field of view. Recently deep learning algorithms have removed its dependence on bulky and expensive external positioning devices. However, improving reconstruction accuracy is still hampered by difficult elevational displacement estimation and large cumulative drift. In this context, we propose a novel deep motion network (MoNet) that integrates images and a lightweight sensor known as the inertial measurement unit (IMU) from a velocity perspective to alleviate the obstacles mentioned above. Our contr…
Rensselaer Polytechnic Institute（伦斯勒理工学院）；National Institutes of Health（美国国立卫生研究院）
Transrectal ultrasound (US) is the most commonly used imaging modality to guide prostate biopsy and its 3D volume provides even richer context information. Current methods for 3D volume reconstruction from freehand US scans require external tracking devices to provide spatial position for every frame. In this paper, we propose a deep contextual learning network (DCL-Net), which can efficiently exploit the image feature relationship between US frames and reconstruct 3D US volumes without any tracking device. The proposed DCL-Net utilizes 3D convolutions over a US video segment for feature extra…
Computational simulation of ultrasound (US) echography is essential for training sonographers. Realistic simulation of US interaction with microscopic tissue structures is often modeled by a tissue representation in the form of point scatterers, convolved with a spatially varying point spread function. This yields a realistic US B-mode speckle texture, given that a scatterer representation for a particular tissue type is readily available. This is often not the case and scatterers are nontrivial to determine. In this work we propose to estimate scatterer maps from sample US B-mode images of a …
Korea Advanced Institute of Science and Technology (KAIST)（韩国高等科学技术院（KAIST））
In portable, three dimensional, and ultra-fast ultrasound imaging systems, there is an increasing demand for the reconstruction of high quality images from a limited number of radio-frequency (RF) measurements due to receiver (Rx) or transmit (Xmit) event sub-sampling. However, due to the presence of side lobe artifacts from RF sub-sampling, the standard beamformer often produces blurry images with less contrast, which are unsuitable for diagnostic purposes. Existing compressed sensing approaches often require either hardware changes or computationally expensive algorithms, but their quality i…
The University of Tokyo（东京大学）；Southeast University（东南大学）
Speech production is a dynamic procedure, which involved multi human organs including the tongue, jaw and lips. Modeling the dynamics of the vocal tract deformation is a fundamental problem to understand the speech, which is the most common way for human daily communication. Researchers employ several sensory streams to describe the process simultaneously, which are incontrovertibly statistically related to other streams. In this paper, we address the following question: given an observable image sequences of lips, can we picture the corresponding tongue motion. We formulated this problem as t…
