Radar sensors are crucial for environment perception of driver assistance systems as well as autonomous cars. Key performance factors are a fine range resolution and the possibility to directly measure velocity. With a rising number of radar sensors and the so far unregulated automotive radar frequency band, mutual interference is inevitable and must be dealt with. Sensors must be capable of detecting, or even mitigating the harmful effects of interference, which include a decreased detection sensitivity. In this paper, we evaluate a Convolutional Neural Network (CNN)-based approach for interference mitigation on real-world radar measurements. We combine real measurements with simulated interference in order to create input-output data suitable for training the model. We analyze the performance to model complexity relation on simulated and measurement data, based on an extensive parameter search. Further, a finite sample size performance comparison shows the effectiveness of the model trained on either simulated or real data as well as for transfer learning. A comparative performance analysis with the state of the art emphasizes the potential of CNN-based models for interference mitigation and denoising of real-world measurements, also considering resource constraints of the hardware.
Fraunhofer Heinrich Hertz Institute（弗劳恩霍夫海因里希·赫兹研究所）；Infineon Technologies AG（英飞凌科技股份公司）；Technical University of Berlin（柏林工业大学）；Technical University of Munich（慕尼黑工业大学）
Commercial radar sensing is gaining relevance and machine learning algorithms constitute one of the key components that are enabling the spread of this radio technology into areas like surveillance or healthcare. However, radar datasets are still scarce and generalization cannot be yet achieved for all radar systems, environment conditions or design parameters. A certain degree of fine tuning is, therefore, usually required to deploy machine-learning-enabled radar applications. In this work, we consider the problem of unsupervised domain adaptation across radar configurations in the context of…
UWB Radar-based Heart Rate Monitoring: A Transfer Learning Approach
Google（谷歌）；NIHR Sheffield Biomedical Research Centre（英国谢菲尔德生物医学研究中心）；Sheffield Teaching Hospitals NHS Foundation Trust（谢菲尔德教学医院国家健康服务基金会信托）；University of Sheffield（谢菲尔德大学）；Imperial College London（伦敦帝国学院）
In this paper, we present a 2D target localization method using two low cost and compact Mellimeter Wave Frequency Modulated Continuous Wave (MMW-FMCW) radars. To create a 2D map we exploit the bilateration method followed by a multi-target tracking block to remove the ghost targets. Finally, we present experimental results based on the data gathered from two FMCW radars operating at $\rm 79 \;GHz$.
RIMformer: An End-to-End Transformer for FMCW Radar Interference Mitigation
School of Electronic and Information Engineering, Beihang University（北京航空航天大学电子信息工程学院）；Hefei Innovation Research Institute of Beihang University（北京航空航天大学合肥创新研究院）
In this paper, leveraging AI, cloud computing and radar technology, we create intelligent sensing that enables smarter applications to improve people's daily lives.
With increasing application of frequency-modulated continuous wave (FMCW) radars in autonomous vehicles, mutual interference among FMCW radars poses a serious threat. Through this paper, we present a novel approach to effectively and elegantly suppress mutual interference in FMCW radars. We first decompose the received signal into modes using variational mode decomposition (VMD) and perform time-frequency analysis using Fourier synchrosqueezed transform (FSST). The interference-suppressed signal is then reconstructed by applying a proposed energy-entropy-based thresholding operation on the tim…
FMCW radar could detect object's range, speed and Angleof-Arrival, advantages are robust to bad weather, good range resolution, and good speed resolution. In this paper, we consider the FMCW radar as a novel interacting interface on laptop. We merge sequences of object's range, speed, azimuth information into single input, then feed to a convolution neural network to learn spatial and temporal patterns. Our model achieved 96% accuracy on test set and real-time test.
Recently, frequency-modulated continuous wave (FMCW) radars with array antennas are gaining in popularity on a wide variety of commercial applications. A usual approach of the range and angle estimation of a target with an array FMCW radar is to form a range-angle matrix with deramped receive signal, and then apply the two-dimensional fast Fourier transformation (2D-FFT) on the range-angle matrix. However, such frequency estimation approaches give bias error because two frequencies on the range-angle matrix are not independent to each other, unlike the 2D angle estimation with a passive planar…
Mutual interference in automotive radar scenarios is going to become a major concern as the density of vehicles with radar sensors in the roads increases. The present work tackles the problem of frequency modulated continuous wave (FMCW) to FMCW and continuous wave interference. In this context, we propose a signal processing technique to blindly identify and remove interference by using the fast Orthogonal Matching Pursuit (OMP) algorithm to project the interference signals in a reduced chirplet basis, and separate it from the target signal with minimal loss of information. Significant reduct…
Multiple-input multiple-output (MIMO) radar has several advantages with respect to the traditional radar array systems in terms of performance and flexibility. However, in order to achieve high angular resolution, a MIMO radar requires a large number of transmit and receive antennas, which increases hardware design and computational complexities. Although spatial compressive sensing (CS) has been recently considered for a pulsed-waveform MIMO radar with sparse random arrays, such methods for the frequency-modulated continuous wave (FMCW) radar remain largely unexplored. In this context, we pro…
In this paper, constant false alarm rate (CFAR) detector-based approaches are proposed for interference mitigation of Frequency modulated continuous wave (FMCW) radars. The proposed methods exploit the fact that after dechirping and low-pass filtering operations the targets' beat signals of FMCW radars are composed of exponential sinusoidal components while interferences exhibit short chirp waves within a sweep. The spectra of interferences in the time-frequency ($t$-$f$) domain are detected by employing a 1-D CFAR detector along each frequency bin and then the detected map is dilated as a mas…
Micro-Doppler signature is a potent feature that has been used for target identification and micro-motion parameter estimation. The extraction of high frequency micro-Doppler signature from frequency modulated continuous wave (FMCW) radar along with the target range and velocity is the problem considered in this article. The severe aliasing of the high micro-Doppler frequency spread is circumvented by the fast time processing in the proposed method. The use of range-Doppler (RD) filtering and empirical mode decomposition (EMD) enables effective out-of-band and in-band noise suppression. Simula…
We investigate the problem of sparse target detection from widely distributed multistatic \textit{Frequency Modulated Continuous Wave} (FMCW) radar systems (using chirp modulation). Unlike previous strategies (\emph{e.g.}, developed for FMCW or distributed multistatic radars), we propose a generic framework that scales well in terms of computational complexity for high-resolution space-velocity grid. Our approach assumes that \emph{(i)} the target signal is sparse in a discrete space-velocity domain, hence allowing for non-static target detection, and \emph{(ii)} the resulting multiple baseban…
The stretch processing architecture is commonly used for frequency modulated continuous wave (FMCW) radar due to its inexpensive hardware, low sampling rate, and simple architecture. However, the stretch processing architecture is not able to achieve optimal Signal to Noise ratio (SNR) in comparison to the matched-filter architecture. In this paper, we aim to propose a method whereby stretch processing can achieve optimal SNR. Hence, we develop a novel processing method to enable applying a matched filter to the output of the stretch processing. The proposed architecture achieves optimal SNR w…
Millimeter-wave (mmWave) radars are being increasingly integrated in commercial vehicles to support new Adaptive Driver Assisted Systems (ADAS) features that require accurate location and Doppler velocity estimates of objects, independent of environmental conditions. To explore radar-based ADAS applications, we have updated our test-bed with Texas Instrument's 4-chip cascaded FMCW radar (TIDEP-01012) that forms a non-uniform 2D MIMO virtual array. In this paper, we develop the necessary received signal models for applying different direction of arrival (DoA) estimation algorithms and experimen…
Dual function radar communications (DFRC) systems are attractive technologies for autonomous vehicles, which utilize electromagnetic waves to constantly sense the environment while simultaneously communicating with neighbouring devices. An emerging approach to implement DFRC systems is to embed information in radar waveforms via index modulation (IM). Implementation of DFRC schemes in vehicular systems gives rise to strict constraints in terms of cost, power efficiency, and hardware complexity. In this paper, we extend IM-based DFRC systems to utilize sparse arrays and frequency modulated cont…
One of the notorious problems of frequency modulated continuous-wave (FMCW) radar is leakage between the transmitter and the receiver. The phase noise of the leakage is expressed as a skirt around the leakage signal on power spectrum. It causes the deterioration of the dynamic range, especially, in the near-distance region. Therefore, although FMCW radar has an advantage over pulse radar in terms of near-distance target detection due to its way of operation, the advantage of FMCW radar can be lost because of the leakage. Another problem of FMCW radar is internal delay in the radar system. It l…
KU Leuven（鲁汶大学）；Ghent University（根特大学）；imec（比利时微电子研究中心）
Frequency-modulated continuous-wave (FMCW) radar is a promising sensor technology for indoor drones as it provides range, angular as well as Doppler-velocity information about obstacles in the environment. Recently, deep learning approaches have been proposed for processing FMCW data, outperforming traditional detection techniques on range-Doppler or range-azimuth maps. However, these techniques come at a cost; for each novel task a deep neural network architecture has to be trained on high-dimensional input data, stressing both data bandwidth and processing budget. In this paper, we investiga…
Millimeter-wave radars are being increasingly integrated into commercial vehicles to support advanced driver-assistance system features. A key shortcoming for present-day vehicular radar imaging is poor azimuth resolution (for side-looking operation) due to the form factor limits on antenna size and placement. In this paper, we propose a solution via a new multiple-input and multiple-output synthetic aperture radar (MIMO-SAR) imaging technique, that applies coherent SAR principles to vehicular MIMO radar to improve the side-view (angular) resolution. The proposed 2-stage hierarchical MIMO-SAR …
The paper proposes a novel feature extraction approach for FMCW radar systems in the field of short-range gesture sensing. A light-weight processing is proposed which reduces a series of 3D radar data cubes to four 1D time signals containing information about range, azimuth angle, elevation angle and magnitude. The processing is entirely performed in the time domain without using any Fourier transformation and enables the training of a deep neural network directly on the raw time domain data. It is shown experimentally on real world data, that the proposed processing retains the same expressiv…
A prior-guided deep learning (DL) based interference mitigation approach is proposed for frequency modulated continuous wave (FMCW) radars. In this paper, the interference mitigation problem is tackled as a regression problem. Considering the complex-valued nature of radar signals, the complex-valued convolutional neural network is utilized as an architecture for implementation, which is different from the conventional real-valued counterparts. Meanwhile, as the useful beat signals of FMCW radars and interferences exhibit different distributions in the time-frequency domain, this prior feature…
A novel matrix pencil-based interference mitigation approach for FMCW radars is proposed in this paper. The interference-contaminated segment of the beat signal is firstly cut out and then the signal samples in the cut-out region are reconstructed by modeling the beat signal as a sum of complex exponentials and using the matrix pencil method to estimate their parameters. The efficiency of the proposed approach for the interference with different parameters (i.e. interference duration, signal-to-noise ratio (SNR), and different target scenarios) is investigated by means of numerical simulations…
In this paper, we use a low-cost low-power mm-wave frequency modulated continuous wave (FMCW) radar for the in-vehicle occupant detection. We propose an algorithm using Capon filter for the joint range-azimuth estimation. Then, the minimum necessary features are extracted to train machine learning classifiers to have reasonable computational complexity while achieving high accuracy. In addition, experiments were carried out in a minivan to detect occupancy of each row using support vector machine (SVM). Finally, our proposed system achieved 97.8% accuracy on average in finding the defined scen…
Frequency modulated continuous wave (FMCW) radar is emerging as a trendy radar system for synthetic aperture radar (SAR). This letter proposes a novel method for the extraction of the SAR image with the FMCW radar. The proposed method can improve the quality of the SAR image. For the verification, we built an automobile SAR (AutoSAR) system and conducted experiments to extract the SAR map by using the AutoSAR system. Then, we synthesized SAR images through both the conventional method and the proposed method to demonstrate the performance of the proposed method. The experimental results show t…
Commercial automotive radars used today are based on frequency modulated continuous wave signals due to the simple and robust detection method and good accuracy. However, the increase in both the number of radars deployed per vehicle and the number of such vehicles leads to mutual interference among automotive radars, and cutting short future plans for autonomous driving and safety. We propose and analyze a radar communication (RadCom) approach to reduce or eliminate this mutual interference while simultaneously offering communication functionality. Our RadCom approach frequency division multi…
Non-contact vital sign detection is a required application nowadays in many fields as patient monitoring and static human detection. Within the last decade, radar has been introduced as a smart and convenient sensor for non-contact respiration monitoring. Radar sensors are considered suitable for such application for its capability to work through obstacles and in harsh environmental conditions. FMCW radar has been introduced as a powerful tool in this field for its capability of detecting both the breathing target position and his chest micro-motions induced due to breathing. Most of the pres…
In this paper, we investigate the application of continuous sparse signal reconstruction algorithms for the estimation of the ranges and speeds of multiple moving targets using an FMCW radar. Conventionally, to be reconstructed, continuous sparse signals are approximated by a discrete representation. This discretization of the signal's parameter domain leads to mismatches with the actual signal. While increasing the grid density mitigates these errors, it dramatically increases the algorithmic complexity of the reconstruction. To overcome this issue, we propose a fast greedy algorithm for off-…
Transformer-Based Heartbeat Monitoring with FMCW Radar Under Random Body Motion
Dept. of Information Engineering, University of Pisa（比萨大学信息工程系）；Radar and Surveillance Systems (RaSS) National Laboratory, CNIT（CNIT雷达与监视系统（RaSS）国家实验室）
