arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.20237eess.SP
收藏

基于生成模型的演化语义通信

Evolving Semantic Communication with Generative Model

Shunpu Tang, Qianqian Yang, Deniz Gündüz, Zhaoyang Zhang

AI总结:

本文提出演化语义通信系统ESemCom,利用信道感知语义编码器和语义缓存机制持续提升图像传输效率,在平均带宽压缩比1/192下优于DeepJSCC等方法。

摘要:

近年来,基于学习的语义通信(SemCom)已成为即将到来的6G网络中一种有前景的方法,研究者们在该领域取得了显著进展。然而,现有工作尚未充分挖掘学习型系统演化特性的优势,即传输过程中积累的知识有潜力提升系统性能。本文探索了一种用于图像传输的演化语义通信系统,称为ESemCom,具备持续提升传输效率的能力。该系统采用一种新颖的信道感知语义编码器,利用预训练的语义StyleGAN从输入图像中提取与信道相关的隐变量,这些隐变量由若干语义向量组成,可直接在含噪信道上传输,无需进一步信道编码。此外,我们引入了一种语义缓存机制,将已传输的语义向量动态存储在发射端和接收端的本地缓存中。随后利用缓存的语义向量,在后续传输中无需再传输相似编码,从而进一步降低通信开销。仿真结果突显了所提系统在传输效率方面的演化性能:在100张测试图像序列上,与相同带宽压缩比(BCR)下的DeepJSCC和Inverse JSCC相比,本系统以平均1/192的带宽压缩比实现了更优的感知质量。本文代码见https://github.com/recusant7/GAN_SeCom。

英文摘要:

Recently, learning-based semantic communication (SemCom) has emerged as a promising approach in the upcoming 6G network and researchers have made remarkable efforts in this field. However, existing works have yet to fully explore the advantages of the evolving nature of learning-based systems, where knowledge accumulates during transmission have the potential to enhance system performance. In this paper, we explore an evolving semantic communication system for image transmission, referred to as ESemCom, with the capability to continuously enhance transmission efficiency. The system features a novel channel-aware semantic encoder that utilizes a pre-trained Semantic StyleGAN to extract the channel-correlated latent variables consisting of serval semantic vectors from the input images, which can be directly transmitted over a noisy channel without further channel coding. Moreover, we introduce a semantic caching mechanism that dynamically stores the transmitted semantic vectors in the local caching memory of both the transmitter and receiver. The cached semantic vectors are then exploited to eliminate the need to transmit similar codes in subsequent transmission, thus further reducing communication overhead. Simulation results highlight the evolving performance of the proposed system in terms of transmission efficiency, achieving superior perceptual quality with an average bandwidth compression ratio (BCR) of 1/192 for a sequence of 100 testing images compared to DeepJSCC and Inverse JSCC with the same BCR. Code of this paper is available at \url{https://github.com/recusant7/GAN_SeCom}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑