arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.14481cs.ITcs.AImath.IT
收藏

语义通信中的速率-失真-复杂度折衷问题

On the Rate-Distortion-Complexity Tradeoff for Semantic Communication

Pengcheng Laboratory(鹏城实验室)

Jingxuan Chai, Yong Xiao, Guangming Shi

AI总结:

本文提出了一种速率-失真-复杂度(RDC)框架,通过引入语义距离和复杂度约束,分析了语义通信中速率、失真和模型复杂度之间的三重折衷关系,并通过实验验证了理论结果。

摘要:

语义通信是一种新的通信范式,其目标是传递用户的意图而非位级传输源信号。关键挑战是有效表示和提取任何给定源信号的语义意义。尽管深度学习(DL)方法在提取隐含语义信息方面表现出色,但现有研究往往忽略了DL编码器和解码器在模型训练和推理中固有的高计算复杂性。为弥合这一差距,本文提出了一种速率-失真-复杂度(RDC)框架,扩展了经典的速率-失真理论,通过引入语义距离约束(包括传统的位级失真度量和基于统计差异的发散度度量)以及复杂度度量(源自最小描述长度理论和信息瓶颈理论)。我们推导了在给定语义距离和复杂度约束下,高斯和二元语义源的最小可实现速率的闭式理论结果。理论结果表明,可实现的速率、语义距离和模型复杂度之间存在根本性的三重折衷关系。在真实世界图像和视频数据集上的广泛实验验证了这一折衷关系,并进一步表明我们的信息论复杂度度量有效关联于实际计算成本,指导资源受限场景下的高效系统设计。

英文摘要:

Semantic communication is a novel communication paradigm that focuses on conveying the user's intended meaning rather than the bit-wise transmission of source signals. One of the key challenges is to effectively represent and extract the semantic meaning of any given source signals. While deep learning (DL)-based solutions have shown promising results in extracting implicit semantic information from a wide range of sources, existing work often overlooks the high computational complexity inherent in both model training and inference for the DL-based encoder and decoder. To bridge this gap, this paper proposes a rate-distortion-complexity (RDC) framework which extends the classical rate-distortion theory by incorporating the constraints on semantic distance, including both the traditional bit-wise distortion metric and statistical difference-based divergence metric, and complexity measure, adopted from the theory of minimum description length and information bottleneck. We derive the closed-form theoretical results of the minimum achievable rate under given constraints on semantic distance and complexity for both Gaussian and binary semantic sources. Our theoretical results show a fundamental three-way tradeoff among achievable rate, semantic distance, and model complexity. Extensive experiments on real-world image and video datasets validate this tradeoff and further demonstrate that our information-theoretic complexity measure effectively correlates with practical computational costs, guiding efficient system design in resource-constrained scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑