arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.03338eess.SPcs.ITcs.LGmath.IT
收藏

抗语义噪声的鲁棒语义通信

Robust Semantic Communications Against Semantic Noise

Zhejiang University(浙江大学);Queen Mary University of London(伦敦玛丽女王大学);Imperial College London(伦敦帝国理工学院)

Qiyu Hu, Guangyi Zhang, Zhijin Qin, Yunlong Cai, Guanding Yu, Geoffrey Ye Li

摘要:

虽然语义通信在大量的任务中表现出令人满意的性能,但语义噪声的影响和系统的鲁棒性还没有得到很好的研究。语义噪声是语义通信系统中的一种特殊噪声,指的是语义符号与接收符号之间的误导。在本文中,我们首先提出了一个框架,鲁棒的端到端的语义通信系统,以打击语义噪声。特别地,我们分析了语义噪声产生的原因,并提出了一种实用的语义噪声产生方法,为了消除语义噪声的影响,我们提出了对抗性训练,将带有语义噪声的样本加入训练数据集中。然后,掩蔽自动编码器(MAE)被设计为一个强大的语义通信系统的架构,其中一部分的输入被屏蔽。为了进一步提高语义通信系统的鲁棒性,本文首先采用矢量量化-变分自编码器(VQ-VAE)设计了一个发送端和接收端共享的离散码本,用于编码特征表示。因此,发射机仅需要在码本中发送这些特征的索引。仿真结果表明,我们提出的方法显着提高了语义通信系统对语义噪声的鲁棒性与显着减少的传输开销。

英文摘要:

Although the semantic communications have exhibited satisfactory performance in a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated. Semantic noise is a particular kind of noise in semantic communication systems, which refers to the misleading between the intended semantic symbols and received ones. In this paper, we first propose a framework for the robust end-to-end semantic communication systems to combat the semantic noise. Particularly, we analyze the causes of semantic noise and propose a practical method to generate it. To remove the effect of semantic noise, adversarial training is proposed to incorporate the samples with semantic noise in the training dataset. Then, the masked autoencoder (MAE) is designed as the architecture of a robust semantic communication system, where a portion of the input is masked. To further improve the robustness of semantic communication systems, we firstly employ the vector quantization-variational autoencoder (VQ-VAE) to design a discrete codebook shared by the transmitter and the receiver for encoded feature representation. Thus, the transmitter simply needs to transmit the indices of these features in the codebook. Simulation results show that our proposed method significantly improves the robustness of semantic communication systems against semantic noise with significant reduction on the transmission overhead.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑