arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2206.02596eess.SP
收藏

一种鲁棒的深度学习文本语义通信系统

A Robust Deep Learning Enabled Semantic Communication System for Text

Xiang Peng, Zhijin Qin, Danlan Huang, Xiaoming Tao, Jianhua Lu, Guangyi Liu, Chengkang Pan

摘要:

随着6 G时代的到来,语义通信的概念越来越受到关注。与传统的通信系统相比,语义通信系统不仅受到存在于无线通信环境中的物理噪声的影响,另外的白高斯噪声,而且由于语义噪声的来源和基于深度学习的系统的性质。在本文中,我们阐述了语义噪声的机制。特别地,我们将语义噪声分为两类:字面语义噪声和对抗性语义噪声。前者是由书写错误或表达歧义引起的,而后者是由通过语义通道添加到嵌入层的扰动或攻击引起的。为了防止语义噪声影响语义通信系统,我们提出了一个强大的深度学习支持的语义通信系统(R-DeepSC),它利用校准的自我注意力机制和对抗训练来解决语义噪声。与仅考虑文本传输的物理噪声的基线模型相比,所提出的R-DeepSC在处理不同信噪比下的语义噪声方面取得了显着的性能。

英文摘要:

With the advent of the 6G era, the concept of semantic communication has attracted increasing attention. Compared with conventional communication systems, semantic communication systems are not only affected by physical noise existing in the wireless communication environment, e.g., additional white Gaussian noise, but also by semantic noise due to the source and the nature of deep learning-based systems. In this paper, we elaborate on the mechanism of semantic noise. In particular, we categorize semantic noise into two categories: literal semantic noise and adversarial semantic noise. The former is caused by written errors or expression ambiguity, while the latter is caused by perturbations or attacks added to the embedding layer via the semantic channel. To prevent semantic noise from influencing semantic communication systems, we present a robust deep learning enabled semantic communication system (R-DeepSC) that leverages a calibrated self-attention mechanism and adversarial training to tackle semantic noise. Compared with baseline models that only consider physical noise for text transmission, the proposed R-DeepSC achieves remarkable performance in dealing with semantic noise under different signal-to-noise ratios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑