arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.16868cs.ITcs.AIcs.CVmath.IT
收藏

基于码本的Transformer驱动的生成式端到端语义通信

Codebook-enabled Generative End-to-end Semantic Communication Powered by Transformer

The Shenzhen Campus of Sun Yat-sen University, Sun Yat-sen University, Shenzhen, China(中山大学深圳校区,中山大学,深圳,中国);Peng Cheng Laboratory, Shenzhen, China(鹏城实验室,深圳,中国);SSE, The Chinese University of Hong Kong, Shenzhen, China(香港中文大学深圳校区,香港中文大学,深圳,中国);Beijing University of Posts(北京邮电大学)

Peigen Ye, Yaping Sun, Shumin Yao, Hao Chen, Xiaodong Xu, Shuguang Cui

AI总结:

本文提出一种鲁棒的码本辅助图像语义通信系统,通过联合构建语义编解码器与码本,并设计码本引导的向量到索引Transformer消除信道噪声,实现高质量图像生成,性能优于JPEG+LDPC和传统JSCC方法。

摘要:

基于码本的生成式语义通信日益受到关注,因为当发射机和接收机共享码本时,只需传输索引即可。然而,由于码向量之间的语义关系不一定与相应码索引的距离相关,基于码本的语义通信系统性能易受信道噪声影响。因此,如何提高系统对噪声的鲁棒性需要精心设计。本文提出了一种鲁棒的码本辅助图像语义通信系统,首先联合构建语义编解码器和码本,然后设计由码本引导的向量到索引Transformer,以消除信道噪声影响并实现图像生成。得益于高质量码本对Transformer的辅助,接收端生成的图像在视觉感知方面优于对比方法。最终,数值结果和生成图像证明了该生成式语义通信方法相比JPEG+LDPC和传统联合信源信道编码(JSCC)方法的优势。

英文摘要:

Codebook-based generative semantic communication attracts increasing attention, since only indices are required to be transmitted when the codebook is shared between transmitter and receiver. However, due to the fact that the semantic relations among code vectors are not necessarily related to the distance of the corresponding code indices, the performance of the codebook-enabled semantic communication system is susceptible to the channel noise. Thus, how to improve the system robustness against the noise requires careful design. This paper proposes a robust codebook-assisted image semantic communication system, where semantic codec and codebook are first jointly constructed, and then vector-to-index transformer is designed guided by the codebook to eliminate the effects of channel noise, and achieve image generation. Thanks to the assistance of the high-quality codebook to the Transformer, the generated images at the receiver outperform those of the compared methods in terms of visual perception. In the end, numerical results and generated images demonstrate the advantages of the generative semantic communication method over JPEG+LDPC and traditional joint source channel coding (JSCC) methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑