arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.14112eess.SP
收藏

大语言模型赋能的语义通信系统

Large-Language-Model Enabled Semantic Communication Systems

Zhenyi Wang, Li Zou, Shengyun Wei, Kai Li, Feifan Liao, Haibo Mi, Rongxuan Lai

AI总结:

本文提出LLM-SC框架,首次将大语言模型直接用于语义通信物理层编解码,利用分词器训练和无监督预训练构建语义知识库与最优译码准则,在无需重训练或信道编码的情况下超越DeepSC并取得显著编码增益。

摘要:

大语言模型(LLMs)近期在各类自然语言处理(NLP)任务中展现出最先进的性能,在多项语言理解挑战中达到接近人类水平,并与语义通信的核心理念高度契合。受LLMs在语义处理方面进展的启发,我们提出了一种创新的LLM赋能语义通信系统框架,命名为LLM-SC,首次将LLMs直接应用于物理层编码与解码。通过分析LLMs训练过程与语义通信优化目标之间的关系,我们提出通过LLMs的分词器训练来训练语义编码器,并借助LLMs的无监督预训练过程建立语义知识库。该知识库通过提供所传输语言序列的先验概率,有助于构建最优解码器。在此基础上,我们推导了接收端的最优译码准则,并引入束搜索算法以进一步降低复杂度。此外,我们断言现有LLMs可直接用于LLM-SC,无需额外的重新训练或微调。仿真结果表明,在信噪比(SNR)超过3 dB时,LLM-SC优于经典的DeepSC,能够在高SNR下实现语义信息的无误传输,而这是DeepSC无法达到的。除语义级性能外,LLM-SC还展现出与技术级性能的兼容性,在比特误码率(BER)为$10^{-3}$时实现约8 dB的编码增益,且无需任何信道编码,同时保持与传统通信系统相同的联合信源信道编码速率。

英文摘要:

Large language models (LLMs) have recently demonstrated state-of-the-art performance across various natural language processing (NLP) tasks, achieving near-human levels in multiple language understanding challenges and aligning closely with the core principles of semantic communication. Inspired by LLMs' advancements in semantic processing, we propose an innovative LLM-enabled semantic communication system framework, named LLM-SC, that applies LLMs directly to the physical layer coding and decoding for the first time. By analyzing the relationship between the training process of LLMs and the optimization objectives of semantic communication, we propose training a semantic encoder through LLMs' tokenizer training and establishing a semantic knowledge base via the LLMs' unsupervised pre-training process. This knowledge base aids in constructing the optimal decoder by providing the prior probability of the transmitted language sequence. Based on this foundation, we derive the optimal decoding criterion for the receiver and introduce the beam search algorithm to further reduce the complexity. Furthermore, we assert that existing LLMs can be employed directly for LLM-SC without additional re-training or fine-tuning. Simulation results demonstrate that LLM-SC outperforms classical DeepSC at signal-to-noise ratios (SNR) exceeding 3 dB, enabling error-free transmission of semantic information under high SNR, which is unattainable by DeepSC. In addition to semantic-level performance, LLM-SC demonstrates compatibility with technical-level performance, achieving approximately 8 dB coding gain for a bit error ratio (BER) of $10^{-3}$ without any channel coding while maintaining the same joint source-channel coding rate as traditional communication systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑