arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2208.08239cs.ITcs.AImath.IT
收藏

基于注意力的强化学习在语义通信中的性能优化

Performance Optimization for Semantic Communications: An Attention-based Reinforcement Learning Approach

Beijing University of Posts and Telecommunications(北京邮电大学);Princeton University(普林斯顿大学);Virginia Tech(弗吉尼亚理工大学);The Chinese University of Hong Kong(香港中文大学);Shenzhen Research Institute of Big Data(深圳大数据研究院);Peng Cheng Laboratory(鹏城实验室)

Yining Wang, Mingzhe Chen, Tao Luo, Walid Saad, Dusit Niyato, H. Vincent Poor, Shuguang Cui

摘要:

本文提出了一个文本数据传输的语义通信框架。在所研究的模型中,一个基站(BS)从文本数据中提取语义信息,并将其发送给每个用户。语义信息由一组语义三元组组成的知识图谱(KG)建模。在接收到语义信息之后,每个用户使用图到文本生成模型来恢复原始文本。为了衡量所考虑的语义通信框架的性能,提出了一种语义相似度(MSS)的度量,该度量共同捕获恢复文本的语义准确性和完整性。由于无线资源的限制,BS可能无法向每个用户发送整个语义信息并满足传输延迟约束。因此,BS必须为每个用户选择适当的资源块,以及确定并向用户发送部分语义信息。因此,我们制定了一个优化问题,其目标是通过共同优化的资源分配政策,并确定要传输的部分语义信息,以最大限度地提高总MSS。针对这一问题,提出了一种基于邻近策略优化的强化学习(RL)算法,并将其与注意力网络相结合。该算法利用注意力网络评估语义信息中每个三元组的重要性,建立语义信息中三元组的重要性分布与总MSS之间的关系。与传统的强化学习算法相比,该算法可以动态调整其学习率,从而确保收敛到局部最优解。

英文摘要:

In this paper, a semantic communication framework is proposed for textual data transmission. In the studied model, a base station (BS) extracts the semantic information from textual data, and transmits it to each user. The semantic information is modeled by a knowledge graph (KG) that consists of a set of semantic triples. After receiving the semantic information, each user recovers the original text using a graph-to-text generation model. To measure the performance of the considered semantic communication framework, a metric of semantic similarity (MSS) that jointly captures the semantic accuracy and completeness of the recovered text is proposed. Due to wireless resource limitations, the BS may not be able to transmit the entire semantic information to each user and satisfy the transmission delay constraint. Hence, the BS must select an appropriate resource block for each user as well as determine and transmit part of the semantic information to the users. As such, we formulate an optimization problem whose goal is to maximize the total MSS by jointly optimizing the resource allocation policy and determining the partial semantic information to be transmitted. To solve this problem, a proximal-policy-optimization-based reinforcement learning (RL) algorithm integrated with an attention network is proposed. The proposed algorithm can evaluate the importance of each triple in the semantic information using an attention network and then, build a relationship between the importance distribution of the triples in the semantic information and the total MSS. Compared to traditional RL algorithms, the proposed algorithm can dynamically adjust its learning rate thus ensuring convergence to a locally optimal solution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑