In this paper, we propose a novel concept of cross-learning, in order to improve SAR images by learning from the camera images. We use a multi-level abstraction approach to materialise knowledge transfer between the two modalities. We also compare the performance of other possible approaches. We provide experimental results on real data to validate the proposed concept.
Synthetic aperture radar (SAR) imagery can provide useful information in a multitude of applications, including climate change, environmental monitoring, meteorology, high dimensional mapping, ship monitoring, or planetary exploration. In this paper, we investigate solutions to a number of inverse problems encountered in SAR imaging. We propose a convex proximal splitting method for the optimization of a cost function that includes a non-convex Cauchy-based penalty. The convergence of the overall cost function optimization is ensured through careful selection of model parameters within a forwa…
For 3D Synthetic Aperture Radar (SAR) imaging, one typical approach is to achieve the cross-track 1D focusing for each range-azimuth pixel after obtaining a stack of 2D complex-valued images. The cross-track focusing is the main difficulty as its aperture length is limited and the antenna positions are usually non-uniformly distributed. Sparsity regularization methods are widely used to tackle these problems. However, these methods are of obvious limitations. The most well-known ones are their heavy computational burdens and unsatisfied stabilities. In this letter, an efficient deep network-ba…
repetition frequency (PRF). Given the system complexity and resource constraints, it is often difficult to achieve high imaging performance and low ambiguity without compromising the swath. In this paper, we propose a joint optimization framework for sparse strip SAR imaging algorithms and azimuth undersampling patterns based on a deep convolutional neural network, combined with matched filter (MF) approximate measurement operators and inverse MF operators, referred to as MF-JMoDL-Net, for sparse SAR imaging methods. Compared with conventional sparse SAR imaging, MF-JMoDL-Net enables us to all…
In this paper, SAR image reconstruction with joint phase error estimation (autofocusing) is formulated as an inverse problem. An optimization model utilising a sparsity-enforcing Cauchy regularizer is proposed, and an alternating minimization framework is used to solve it, in which the desired image and the phase errors are optimized alternatively. For the image reconstruction sub-problem (f-sub-problem), two methods are presented capable of handling the problem's complex nature, and we thus present two variants of our SAR image autofocusing algorithm. Firstly, we design a complex version of t…
Millimeter-wave radars are being increasingly integrated into commercial vehicles to support advanced driver-assistance system features. A key shortcoming for present-day vehicular radar imaging is poor azimuth resolution (for side-looking operation) due to the form factor limits on antenna size and placement. In this paper, we propose a solution via a new multiple-input and multiple-output synthetic aperture radar (MIMO-SAR) imaging technique, that applies coherent SAR principles to vehicular MIMO radar to improve the side-view (angular) resolution. The proposed 2-stage hierarchical MIMO-SAR …
In the next generations of cellular communication networks, higher density of base stations and higher frequency bands will be adopted. If being reflected by targets, the communication signal also brings information of the targets, in addition to the communication messages, to the receivers. In this paper, it is proposed to leverage the reflected communication signals to reconstruct an image of the environment. Due to the analogy to traditional synthetic aperture radar (SAR) and inverse SAR (ISAR), the principles of SAR and ISAR, namely the tomography via Fourier transformation, are adopted wi…
This paper deals with the analysis, estimation, and compensation of trajectory errors in automotive-based Synthetic Aperture Radar (SAR) systems. First of all, we define the geometry of the acquisition and the model of the received signal. We then proceed by analytically evaluating the effect of an error in the vehicle's trajectory. Based on the derived model, we introduce a motion compensation (MoCo) procedure capable of estimating and compensating constant velocity motion errors leading to a well-focused and well-localized SAR image. The procedure is validated using real data gathered by a 7…
This paper presents a quadrature compressive sampling (QuadCS) and associated fast imaging scheme for synthetic aperture radar (SAR). Different from other analog-to-information conversions (AIC), QuadCS AICs using independent spreading signals sample the SAR echoes due to different transmitted pulses. Then the resulting sensing matrix has lower correlation between any two columns than that by a fixed spreading signal, and better SAR image can be reconstructed. With proper setting of the spreading signals in QuadCS, the sensing matrix has the structures suitable for fast computation of matrix-v…
Automotive synthetic aperture radar (SAR) systems are rapidly emerging as a candidate technological solution to enable a high-resolution environment mapping for autonomous driving. Compared to lidars and cameras, automotive-legacy radars can work in any weather condition and without an external source of illumination, but are limited in either range or angular resolution. SARs offer a relevant increase in angular resolution, provided that the ego-motion of the radar platform is known along the synthetic aperture. In this paper, we present the results of an experimental campaign aimed at assess…
Synthetic aperture radar (SAR) tomography (TomoSAR) enables the reconstruction and three-dimensional (3D) localization of targets based on multiple two-dimensional (2D) observations of the same scene. The resolving along the elevation direction can be treated as a line spectrum estimation problem. However, traditional super-resolution spectrum estimation algorithms require multiple snapshots and uncorrelated targets. Meanwhile, as the most popular TomoSAR imaging method in modern years, compressed sensing (CS) based methods suffer from the gridding mismatch effect which markedly degrades the i…
In this paper, we present an approach for ground moving target imaging (GMTI) and velocity recovery using synthetic aperture radar. We formulate the GMTI problem as the recovery of a phase-space reflectivity (PSR) function which represents the strengths and velocities of the scatterers in a scene of interest. We show that the discretized PSR matrix can be decomposed into a rank-one, and a highly sparse component corresponding to the stationary and moving scatterers, respectively. We then recover the two distinct components by solving a constrained optimization problem that admits computational…
Integrating Low-Altitude SAR Imaging into UAV Data Backhaul
Nanjing University of Information Science and Technology(南京信息工程大学);National Mobile Communications Research Laboratory, Southeast University(东南大学移动通信国家重点实验室);Southeast University(东南大学);Beijing University of Posts and Telecommunications(北京邮电大学);Southern University of Science and Technology (SUSTech)(南方科技大学);Shanghai Jiao Tong University(上海交通大学)
The joint interpretation of very high resolution SAR and optical images in dense urban area are not trivial due to the distinct imaging geometry of the two types of images. Especially, the inevitable layover caused by the side-looking SAR imaging geometry renders this task even more challenging. Only until recently, the "SARptical" framework [1], [2] proposed a promising solution to tackle this. SARptical can trace individual SAR scatterers in corresponding high-resolution optical images, via rigorous 3-D reconstruction and matching. This paper introduces the SARptical dataset, which is a data…
Tomographic synthetic aperture radar (TomoSAR) imaging algorithms based on deep learning can effectively reduce computational costs. The idea of existing researches is to reconstruct the elevation for each range-azimuth cell in one-dimensional using a deep-unfolding network. However, since these methods are commonly sensitive to signal sparsity level, it usually leads to some drawbacks like continuous surface fractures, too many outliers, \textit{et al}. To address them, in this paper, a novel imaging network (AETomo-Net) based on multi-dimensional features is proposed. By adding a U-Net-like …
University of Electronic Science and Technology of China(电子科技大学)
Deep learning (DL)-based tomographic SAR imaging algorithms are gradually being studied. Typically, they use an unfolding network to mimic the iterative calculation of the classical compressive sensing (CS)-based methods and process each range-azimuth unit individually. However, only one-dimensional features are effectively utilized in this way. The correlation between adjacent resolution units is ignored directly. To address that, we propose a new model-data-driven network to achieve tomoSAR imaging based on multi-dimensional features. Guided by the deep unfolding methodology, a two-dimension…
We analyze synthetic aperture radar (SAR) imaging of complex ground scenes that contain both stationary and moving targets. In the usual SAR acquisition scheme, we consider ways to preprocess the data so as to separate the contributions of the moving targets from those due to stationary background reflectors. Both components of the data, that is, reflections from stationary and moving targets, are considered as signal that is needed for target imaging and tracking, respectively. The approach we use is to decompose the data matrix into a low rank and a sparse part. This decomposition enables us…
This paper proposes the use of sufficient cyclic prefix (CP) OFDM synthetic aperture radar (SAR) for foliage penetration (FOPEN). The foliage introduces phase and amplitude fluctuation which cause the sidelobes to increase and affects the final image of the obscured targets. The wideband CP-based OFDM SAR inherently eliminates the sidelobes that arise from the interference between targets on the same range line. The integrated sidelobe level ratio (ISLR) of the CP-based OFDM signal along the range direction is lower than that of the random noise signal by 2 dB for foliage penetration applicati…
University of Electronic Science and Technology of China(电子科技大学);Oklahoma State University(俄克拉荷马州立大学)
Unmanned aerial vehicle (UAV) can provide superior flexibility and cost-efficiency for modern radar imaging systems, which is an ideal platform for advanced remote sensing applications using synthetic aperture radar (SAR) technology. In this paper, an energy-efficient passive UAV radar imaging system using illuminators of opportunity is first proposed and investigated. Equipped with a SAR receiver, the UAV platform passively reuses the backscattered signal of the target scene from an external illuminator, such as SAR satellite, GNSS or ground-based stationary commercial illuminators, and achie…
ATASI-Net: An Efficient Sparse Reconstruction Network for Tomographic SAR Imaging with Adaptive Threshold
Suzhou Aerospace Information Research Institute(苏州空天信息研究院);Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院);George Mason University(乔治梅森大学)
Inevitable interferences exist for the SAR system, adversely affecting the imaging quality. However, current analysis and suppression methods mainly focus on the far-field situation. Due to different sources and characteristics of interferences, they are not applicable in the near field. To bridge this gap, in the first time, analysis and the suppression method of interferences in near-field SAR are presented in this work. We find that echoes from both the nadir points and the antenna coupling are the main causes, which have the constant-time-delay feature. To characterize this, we further est…
Originally developed in fields such as robotics and autonomous driving with image-based navigation in mind, deep learning-based single-image depth estimation (SIDE) has found great interest in the wider image analysis community. Remote sensing is no exception, as the possibility to estimate height maps from single aerial or satellite imagery bears great potential in the context of topographic reconstruction. A few pioneering investigations have demonstrated the general feasibility of single image height prediction from optical remote sensing images and motivate further studies in that directio…
As an emerging approach to space situational awareness and space imaging, the practical use of an event-based camera in space imaging for precise source analysis is still in its infancy. The nature of event-based space imaging and data collection needs to be further explored to develop more effective event-based space image systems and advance the capabilities of event-based tracking systems with improved target measurement models. Moreover, for event measurements to be meaningful, a framework must be investigated for event-based camera calibration to project events from pixel array coordinate…
UAV SAR Imaging via Diffusion Posterior Sampling under Non-Ideal Motion in ISAC Systems
National Mobile Communications Research Laboratory, Southeast University(东南大学移动通信国家重点实验室);Purple Mountain Laboratories(紫金山实验室);Frontiers Science Center for Mobile Information Communication and Security, Southeast University(东南大学移动信息通信与安全前沿科学中心)
A Novel Gradient Descent Least Squares (GDLS) Algorithm for Efficient SMV Gridless Line Spectrum Estimation with Applications in Tomographic SAR Imaging
A problem with synthetic aperture radar (SAR) is that due to the poor penetrating action of electromagnetic waves within solid bodies, the ability to observe through distributed targets is precluded. In this context, indeed, imaging is only possible on targets distribute on the scene surface. This work describes an imaging method based on the analysis of micro-motions present on volcanoes and generated by the underground Earth's heat. Processing the coherent vibrational information embedded on the single SAR image, in the single-look-complex configuration, the sound information is exploited, p…
We consider a bistatic configuration with a stationary transmitter transmitting unknown waveforms of opportunity and a moving receiver, and present a Deep Learning (DL) framework for passive synthetic aperture radar (SAR) imaging. Existing passive radar methods require two or more antennas which are either spatially separated or colocated with sufficient directivity to estimate the underlying waveform prior to imaging. Our approach to passive radar only requires a single receiver, hence reduces cost and increases versatility. We approach DL from an optimization perspective and formulate image …
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);University of Chinese Academy of Sciences(中国科学院大学);German Aerospace Center (DLR)(德国航空航天中心)
The classification of large-scale high-resolution SAR land cover images acquired by satellites is a challenging task, facing several difficulties such as semantic annotation with expertise, changing data characteristics due to varying imaging parameters or regional target area differences, and complex scattering mechanisms being different from optical imaging. Given a large-scale SAR land cover dataset collected from TerraSAR-X images with a hierarchical three-level annotation of 150 categories and comprising more than 100,000 patches, three main challenges in automatically interpreting SAR im…