arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.12121cs.LG
收藏

基于语义相似度的强化学习语义交流

Reinforcement Learning-powered Semantic Communication via Semantic Similarity

College of Information Science and Electronic Engineering, Zhejiang University(浙江大学信息与电子工程学院);VTT Technical Research Centre of Finland(芬兰VTT技术研究中心);Zhejiang Lab(之江实验室)

Kun Lu, Rongpeng Li, Xianfu Chen, Zhifeng Zhao, Honggang Zhang

摘要:

我们引入了一种新的语义通信机制- SemanticRL,其核心思想是保持语义信息,而不是严格保证比特级精度。与以往的方法主要集中在网络或结构设计,我们重新审视学习过程,并指出常用的目标函数的语义盲目性。为了解决这一语义差距,我们引入了一个从语义相似性中学习的示意性转变,而不是依赖于传统的成对比特级监督,如交叉熵和比特出错率。然而,考虑到大多数语义度量的不可微性以及来自噪声信道的不稳定性,开发这样的语义通信系统确实是一项不平凡的任务。为了进一步解决这些问题,我们提出了一个自我批评强化学习(RL)的解决方案,允许一个有效的和稳定的学习任何用户定义的语义测量,并采取进一步的同时解决不可微的语义通道优化问题,通过自我批评随机迭代更新(SCSIU)训练解耦的语义收发器。我们首先在具有挑战性的欧洲议会数据集上对所提出的方法进行了测试,这证实了我们的方法在揭示语义方面的优势,并且更好地处理了语义噪声。除了实验结果,我们还深入研究了语义模型的行为,以及它在现实生活中的泛化能力。一个基于RL的图像传输扩展也被举例说明,以证明泛化能力和激励未来的讨论。

英文摘要:

We introduce a new semantic communication mechanism - SemanticRL, whose key idea is to preserve the semantic information instead of strictly securing the bit-level precision. Unlike previous methods that mainly concentrate on the network or structure design, we revisit the learning process and point out the semantic blindness of commonly used objective functions. To address this semantic gap, we introduce a schematic shift that learns from semantic similarity, instead of relying on conventional paired bit-level supervisions like cross entropy and bit error rate. However, developing such a semantic communication system is indeed a nontrivial task considering the non-differentiability of most semantic metrics as well as the instability from noisy channels. To further resolve these issues, we put forward a self-critic reinforcement learning (RL) solution which allows an efficient and stable learning on any user-defined semantic measurement, and take a step further to simultaneously tackle the non-differentiable semantic channel optimization problem via self-critic stochastic iterative updating (SCSIU) training on the decoupled semantic transceiver. We have firstly tested the proposed method in the challenging European-parliament dataset, which confirms the superiority of our method in revealing the semantic meanings, and better handling the semantic noise. Apart from the experimental results, we further provide an in-depth look at how the semantic model behaves, along with its superb generalization ability in real-life examples. An RL-based image transmission extension is also exemplified, so as to prove the generalization ability and motivate future discussion.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑