Backdoor Attacks for Remote Sensing Data with Wavelet Transform
Institute of Advanced Research in Artificial Intelligence(人工智能高级研究院);TU Wien(维也纳工业大学);Helmholtz-Zentrum Dresden-Rossendorf(亥姆霍兹德累斯顿罗森多夫研究中心);Helmholtz Institute Freiberg for Resource Technology(亥姆霍兹弗赖贝格资源技术研究所)
Nikolaus Dräger, Yonghao Xu, Pedram Ghamisi
发表信息:
IEEE Trans. Geos. Remote Sens., vol. 61, pp. 1-15, 2023
Recent years have witnessed the great success of deep learning algorithms in the geoscience and remote sensing realm. Nevertheless, the security and robustness of deep learning models deserve special attention when addressing safety-critical remote sensing tasks. In this paper, we provide a systematic analysis of backdoor attacks for remote sensing data, where both scene classification and semantic segmentation tasks are considered. While most of the existing backdoor attack algorithms rely on visible triggers like squared patches with well-designed patterns, we propose a novel wavelet transform-based attack (WABA) method, which can achieve invisible attacks by injecting the trigger image into the poisoned image in the low-frequency domain. In this way, the high-frequency information in the trigger image can be filtered out in the attack, resulting in stealthy data poisoning. Despite its simplicity, the proposed method can significantly cheat the current state-of-the-art deep learning models with a high attack success rate. We further analyze how different trigger images and the hyper-parameters in the wavelet transform would influence the performance of the proposed method. Extensive experiments on four benchmark remote sensing datasets demonstrate the effectiveness of the proposed method for both scene classification and semantic segmentation tasks and thus highlight the importance of designing advanced backdoor defense algorithms to address this threat in remote sensing scenarios. The code will be available online at \url{https://github.com/ndraeger/waba}.
Wavelet-Guided Dual-Frequency Encoding for Remote Sensing Change Detection
School of Computer Science and Technology, Shandong Technology and Business University(山东科技职业大学计算机科学与技术学院);College of Computer and Data Science, Fuzhou University(福州大学计算机与数据科学学院);College of Computer Science and Technology, Qingdao University(青岛大学计算机科学与技术学院);School of Computer Science and Engineering, South China University of Technology(华南理工大学计算机科学与工程学院)
Cloud detection is a specialized application of image recognition and object detection using remotely sensed data. The task presents a number of challenges, including analyzing images obtained in visible, infrared and multi-spectral frequencies, usually without ground truth data for comparison. Moreover, machine learning and deep learning (MLDL) algorithms applied to this task are required to be computationally efficient, as they are typically deployed in low-power devices and called to operate in real-time. This paper explains Wavelet Transform (WT) theory, comparing it to more widely used im…
University of Bristol(布里斯托大学);Shanghai Em-Data Technology Co., Ltd.(上海数慧科技股份有限公司);China University of Mining and Technology(中国矿业大学);University of Derby(德比大学)
Polarimetric synthetic aperture radar (PolSAR) image segmentation is currently of great importance in image processing for remote sensing applications. However, it is a challenging task due to two main reasons. Firstly, the label information is difficult to acquire due to high annotation costs. Secondly, the speckle effect embedded in the PolSAR imaging process remarkably degrades the segmentation performance. To address these two issues, we present a contextual PolSAR image semantic segmentation method in this paper.With a newly defined channelwise consistent feature set as input, the three-d…
AI Security for Geoscience and Remote Sensing: Challenges and Future Trends
Institute of Advanced Research in Artificial Intelligence(人工智能高等研究院);Nanyang Technological University(南洋理工大学);Helmholtz-Zentrum Dresden-Rossendorf(亥姆霍兹德累斯顿罗森多夫研究中心);Lancaster University(兰卡斯特大学);University of Southampton(南安普顿大学)
An ideal fusion method preserves the Spectral information in fused image and adds spatial information to it with no spectral distortion. Recently wavelet kalman filter method is proposed which uses ARSIS concept to fuses MS and PAN images. This method is applied in a multiscale version, i.e. the variable index is scale instead of time. With the aim of fusion we present a more detailed study on this model and discuss about rationality of its assumptions such as first order markov model and Gaussian distribution of the posterior density. Finally, we propose a method using wavelet Kalman Particle…
College of Land Science and Technology, China Agricultural University(土地科学与技术学院,中国农业大学);Aerospace Information Research Institute, Chinese Academy of Sciences(航空信息研究所,中国科学院);Faculty of Geosciences and Engineering, Southwest Jiaotong University(地质科学与工程学院,西南交通大学);Helmholtz-Zentrum Dresden-Rossendorf, Helmholtz Institute Freiberg for Resource Technology(德累斯顿-罗斯托克亥姆霍尔茨中心,资源技术亥姆霍尔茨研究所);Lancaster Environment Centre, Lancaster University(兰卡斯特大学环境研究中心)
RDNet: Region Proportion-Aware Dynamic Adaptive Salient Object Detection Network in Optical Remote Sensing Images
School of Control Science and Engineering, Shandong University(控制科学与工程学院,山东大学);Key Laboratory of Machine Intelligence and System Control, Ministry of Education(教育部智能信息与系统控制重点实验室);School of Automation, Hangzhou Dianzi University(自动化学院,杭州电子科技大学);School of Mathematics and Computer Science, Lishui University(数学与计算机科学学院,丽水大学);School of Data Science, Lingnan University(数据科学学院,岭南大学)
LaserGuider: A Laser Based Physical Backdoor Attack against Deep Neural Networks
ShanghaiTech University(上海科技大学);Pengcheng Laboratory(鹏城实验室);Key Laboratory of System Software (Chinese Academy of Sciences) and State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Science(中国科学院软件研究所系统软件重点实验室与计算机科学国家重点实验室);Nanjing Institute of Software Technology(南京软件技术研究院)
Image registration is the process of transforming different sets of data into one coordinate system and is required for various remote sensing applications like change detection, image fusion, and other related areas. The effect of increased relief displacement, requirement of more control points, and increased data volume are the challenges associated with the registration of high resolution image data. The objective of this research work is to study the most efficient techniques and to investigate the extent of improvement achievable by enhancing them with Wavelet transform. The SIFT feature…
University of Trento(特伦托大学);Technische Universität Berlin(柏林工业大学)
To reduce the storage requirements, remote sensing (RS) images are usually stored in compressed format. Existing scene classification approaches using deep neural networks (DNNs) require to fully decompress the images, which is a computationally demanding task in operational applications. To address this issue, in this paper we propose a novel approach to achieve scene classification in JPEG 2000 compressed RS images. The proposed approach consists of two main steps: i) approximation of the finer resolution sub-bands of reversible biorthogonal wavelet filters used in JPEG 2000; and ii) charact…
Sub-pixel registration is a crucial step for applications such as super-resolution in remote sensing, motion compensation in magnetic resonance imaging, and non-destructive testing in manufacturing, to name a few. Recently, these technologies have been trending towards wavelet encoded imaging and sparse/compressive sensing. The former plays a crucial role in reducing imaging artifacts, while the latter significantly increases the acquisition speed. In view of these new emerging needs for applications of wavelet encoded imaging, we propose a sub-pixel registration method that can achieve direct…
University of Maryland(马里兰大学);Johns Hopkins University(约翰斯·霍普金斯大学);US Census Bureau(美国人口普查局)
We develop an algorithm for single-image superresolution of remotely sensed data, based on the discrete shearlet transform. The shearlet transform extracts directional features of signals, and is known to provide near-optimally sparse representations for a broad class of images. This often leads to superior performance in edge detection and image representation when compared to isotropic frames. We justify the use of shearlets mathematically, before presenting a denoising single-image superresolution algorithm that combines the shearlet transform with sparse mixing estimators (SME). Our algori…
Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);University of Chinese Academy of Sciences(中国科学院大学);Quaid-e-Awam University Engineering Science and Technology(奎德阿瓦姆工程科技大学);Salim Habib University(萨利姆·哈比卜大学);Waterford Institute of Technology(沃特福德理工学院)
Single Image Super-resolution (SISR) produces high-resolution images with fine spatial resolutions from aremotely sensed image with low spatial resolution. Recently, deep learning and generative adversarial networks(GANs) have made breakthroughs for the challenging task of single image super-resolution (SISR). However, thegenerated image still suffers from undesirable artifacts such as, the absence of texture-feature representationand high-frequency information. We propose a frequency domain-based spatio-temporal remote sensingsingle image super-resolution technique to reconstruct the HR image…
Image fusion produces a single fused image from a set of input images. A new method for image fusion is proposed based on Weighted Average Merging Method (WAMM) in the NonSubsampled Contourlet Transform (NSCT) domain. A performance analysis on various statistical fusion rules are also analysed both in NSCT and Wavelet domain. Analysis has been made on medical images, remote sensing images and multi focus images. Experimental results shows that the proposed method, WAMM obtained better results in NSCT domain than the wavelet domain as it preserves more edges and keeps the visual quality intact …
GDSR: Global-Detail Integration through Dual-Branch Network with Wavelet Losses for Remote Sensing Image Super-Resolution
School of Computer Technology and Application, Qinghai University(青海大学计算机技术与应用学院);Qinghai Provincial Laboratory for Intelligent Computing and Application, Qinghai University(青海省智能计算与应用实验室);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);School of Computer and Information Science, Qinghai Institute of Technology(青海理工大学计算机与信息科学学院);College of Agriculture and Animal Husbandry, Qinghai University(青海大学农业与动物科学学院)
Scientific Research Group in Egypt (SRGE)(埃及科学研究组);Benha University(本哈大学);Damietta University(达米埃塔大学);Cairo University(开罗大学)
Remote sensing image fusion is an effective way to use a large volume of data from multisensor images. Most earth satellites such as SPOT, Landsat 7, IKONOS and QuickBird provide both panchromatic (Pan) images at a higher spatial resolution and multispectral (MS) images at a lower spatial resolution and many remote sensing applications require both high spatial and high spectral resolutions, especially for GIS based applications. An effective image fusion technique can produce such remotely sensed images. Image fusion is the combination of two or more different images to form a new image by us…
In this paper, we consider the problem of super-resolution recons-truction. This is a hot topic because super-resolution reconstruction has a wide range of applications in the medical field, remote sensing monitoring, and criminal investigation. Compared with traditional algorithms, the current super-resolution reconstruction algorithm based on deep learning greatly improves the clarity of reconstructed pictures. Existing work like Super-Resolution Using a Generative Adversarial Network (SRGAN) can effectively restore the texture details of the image. However, experimentally verified that the …
VNRVJIET(瓦利瓦纳蒂·纳加尔朱纳·拉奥·维贾雅·贾瓦哈尔·工程技术学院);GNITS(吉特工程学院);JNTU College of Engineering(贾瓦哈拉尔·尼赫鲁科技大学工程学院)
Image fusion is to reduce uncertainty and minimize redundancy in the output while maximizing relevant information from two or more images of a scene into a single composite image that is more informative and is more suitable for visual perception or processing tasks like medical imaging, remote sensing, concealed weapon detection, weather forecasting, biometrics etc. Image fusion combines registered images to produce a high quality fused image with spatial and spectral information. The fused image with more information will improve the performance of image analysis algorithms used in different…
Noise-Aware and Dynamically Adaptive Federated Defense Framework for SAR Image Target Recognition
Shanxi Key Laboratory of Cryptography and Data Security, School of Computer Science and Artificial Intelligence, Shanxi Normal University(山西密码与数据安全重点实验室,计算机科学与人工智能学院,山西师范大学);School of Computer Science and Technology, Guizhou University(贵州大学计算机科学与技术学院);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院);School of Electrical Engineering, Guangxi University(广西大学电气工程学院);School of Computing, Engineering and Mathematical Science, La Trobe University(拉筹伯大学计算、工程与数学科学学院);College of Cyber Security, Jinan University(济南大学网络安全学院)
Southwest Jiaotong University(西南交通大学);State-province Joint Engineering Laboratory of Spatial Information Technology for High-speed Railway Safety, Southwest Jiaotong University(高速铁路安全空间信息技术省部共建工程实验室,西南交通大学);Xinyang Normal University(信阳师范学院);Northwest Institute of Nuclear Technology(西北核技术研究所)
Automatically identifying feature correspondences between multimodal images is facing enormous challenges because of the significant differences both in radiation and geometry. To address these problems, we propose a novel feature matching method (named R2FD2) that is robust to radiation and rotation differences. Our R2FD2 is conducted in two critical contributions, consisting of a repeatable feature detector and a rotation-invariant feature descriptor. In the first stage, a repeatable feature detector called the Multi-channel Auto-correlation of the Log-Gabor (MALG) is presented for feature d…
The recent advancement in computing technologies and resulting vision based applications have gives rise to a novel practice called telemedicine that requires patient diagnosis images or allied information to recommend or even perform diagnosis practices being located remotely. However, to ensure accurate and optimal telemedicine there is the requirement of seamless or flawless biomedical information about patient. On the contrary, medical data transmitted over insecure channel often remains prone to get manipulated or corrupted by attackers. The existing cryptosystems alone are not sufficient…
Most multispectral remote sensors (e.g. QuickBird, IKONOS, and Landsat 7 ETM+) provide low-spatial high-spectral resolution multispectral (MS) or high-spatial low-spectral resolution panchromatic (PAN) images, separately. In order to reconstruct a high-spatial/high-spectral resolution multispectral image volume, either the information in MS and PAN images are fused (i.e. pansharpening) or super-resolution reconstruction (SRR) is used with only MS images captured on different dates. Existing methods do not utilize temporal information of MS and high spatial resolution of PAN images together to …
NASA Goddard Space Flight Center(美国国家航空航天局戈达德太空飞行中心);Ball Aerospace and Technologies Corp.(鲍尔航空航天技术公司);Adnet Systems Inc.(Adnet系统公司)
Image registration, or alignment of two or more images covering the same scenes or objects, is of great interest in many disciplines such as remote sensing, medical imaging, astronomy, and computer vision. In this paper, we introduce a new application of image registration algorithms. We demonstrate how through a wavelet based image registration algorithm, engineers can evaluate stability of Micro-Electro-Mechanical Systems (MEMS). In particular, we applied image registration algorithms to assess alignment stability of the MicroShutters Subsystem (MSS) of the Near Infrared Spectrograph (NIRSpe…