基于U-Net的生成式联合源信道编码用于无线图像传输
U-Net-Based Generative Joint Source-Channel Coding for Wireless Image Transmission
AI总结:
本文提出基于U-Net的生成式联合源信道编码方法,通过深度学习提升无线图像传输的像素保真度和感知质量。
摘要:
深度学习(DL)基于的联合源信道编码(JSCC)方法在无线图像传输中取得了显著成功。然而,这些方法要么专注于传统失真度量标准,这些标准不一定能产生高质量的感知质量,要么会带来较高的计算复杂性。在本文中,我们提出了两种基于深度学习的JSCC(DeepJSCC)方法,利用深度生成架构进行无线图像传输。具体而言,我们提出了G-UNet-JSCC,该方案包括一个编码器和一个基于U-Net的生成器作为解码器。其跳接连接使多尺度特征融合得以实现,从而通过整合低层次和高层次特征来提高重建图像的像素级保真度和感知质量。为了进一步提高像素级保真度,编码器和基于U-Net的解码器通过结构相似性和均方误差(MSE)损失的加权和进行联合优化。在G-UNet-JSCC的基础上,我们进一步开发了一种称为cGAN-JSCC的DeepJSCC方法,其中解码器通过对抗训练得到增强。在该方案中,我们保留了G-UNet-JSCC的编码器,并通过对抗训练解码器的生成器对抗基于块的判别器。cGAN-JSCC采用两阶段训练过程。外阶段通过MSE损失对编码器和解码器进行端到端训练,而内阶段通过最小化结合对抗损失和失真损失的联合损失来对抗训练解码器的生成器和判别器。仿真结果表明,所提出的方法在高分辨率和低分辨率图像上均实现了更高的像素级保真度和感知质量。对于低分辨率图像,cGAN-JSCC在重建性能和对信道变化的鲁棒性方面优于G-UNet-JSCC。
英文摘要:
Deep learning (DL)-based joint source-channel coding (JSCC) methods have achieved remarkable success in wireless image transmission. However, these methods either focus on conventional distortion metrics that do not necessarily yield high perceptual quality or incur high computational complexity. In this paper, we propose two DL-based JSCC (DeepJSCC) methods that leverage deep generative architectures for wireless image transmission. Specifically, we propose G-UNet-JSCC, a scheme comprising an encoder and a U-Net-based generator serving as the decoder. Its skip connections enable multi-scale feature fusion to improve both pixel-level fidelity and perceptual quality of reconstructed images by integrating low- and high-level features. To further enhance pixel-level fidelity, the encoder and the U-Net-based decoder are jointly optimized using a weighted sum of structural similarity and mean-squared error (MSE) losses. Building upon G-UNet-JSCC, we further develop a DeepJSCC method called cGAN-JSCC, where the decoder is enhanced through adversarial training. In this scheme, we retain the encoder of G-UNet-JSCC and adversarially train the decoder's generator against a patch-based discriminator. cGAN-JSCC employs a two-stage training procedure. The outer stage trains the encoder and the decoder end-to-end using an MSE loss, while the inner stage adversarially trains the decoder's generator and the discriminator by minimizing a joint loss combining adversarial and distortion losses. Simulation results demonstrate that the proposed methods achieve superior pixel-level fidelity and perceptual quality on both high- and low-resolution images. For low-resolution images, cGAN-JSCC achieves better reconstruction performance and greater robustness to channel variations than G-UNet-JSCC.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。