arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.11519cs.CVeess.SP
收藏

矢量量化语义通信系统

Vector Quantized Semantic Communication System

Queen Mary University of London(伦敦玛丽女王大学);Tsinghua University(清华大学)

Qifan Fu, Huiqiang Xie, Zhijin Qin, Gregory Slabaugh, Xiaoming Tao

AI总结:

本文提出VQ-DeepSC,一种基于深度学习和矢量量化的数字语义通信系统,通过CNN收发器与多尺度语义嵌入实现图像传输,兼具鲁棒性和高质量重建。

摘要:

尽管模拟语义通信系统在文献中已受到相当多的关注,但关于数字语义通信系统的研究较少。本文开发了一种深度学习(DL)驱动的矢量量化(VQ)语义通信系统,用于图像传输,命名为VQ-DeepSC。具体而言,我们提出了一种基于卷积神经网络(CNN)的收发器,用于提取图像的多尺度语义特征,并引入多尺度语义嵌入空间来执行语义特征量化,使数据与数字通信系统兼容。此外,我们采用对抗训练,通过引入PatchGAN判别器来提高接收图像的质量。实验结果表明,所提出的VQ-DeepSC在数字通信系统中比BPG更具鲁棒性,并且具有与DeepJSCC方法相当的MS-SSIM性能。

英文摘要:

Although analog semantic communication systems have received considerable attention in the literature, there is less work on digital semantic communication systems. In this paper, we develop a deep learning (DL)-enabled vector quantized (VQ) semantic communication system for image transmission, named VQ-DeepSC. Specifically, we propose a convolutional neural network (CNN)-based transceiver to extract multi-scale semantic features of images and introduce multi-scale semantic embedding spaces to perform semantic feature quantization, rendering the data compatible with digital communication systems. Furthermore, we employ adversarial training to improve the quality of received images by introducing a PatchGAN discriminator. Experimental results demonstrate that the proposed VQ-DeepSC is more robustness than BPG in digital communication systems and has comparable MS-SSIM performance to the DeepJSCC method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑