使用条件扩散模型的速率自适应生成式语义通信
Rate-Adaptive Generative Semantic Communication Using Conditional Diffusion Models
AI总结:
本文提出一种基于条件扩散模型和MLLA骨架的生成式DJSCC方法,利用熵模型自适应管理带宽并以符号作为条件信息指导图像重建,结合多阶段训练策略,显著提升了语义图像传输的感知质量。
摘要:
近期基于深度学习的联合信源信道编码(DJSCC)的进展已显示出用于端到端语义图像传输的潜力。然而,大多数现有方案主要侧重于优化像素级指标,这通常无法与人类感知保持一致,导致感知质量较低。在本文中,我们提出了一种使用条件扩散模型的新型生成式DJSCC方法,以增强传输图像的感知质量。具体而言,通过利用熵模型,我们根据传输符号的估计熵来有效管理传输带宽。这些符号随后在接收端被用作条件信息,以指导条件扩散解码器进行图像重建。我们的模型建立在新兴的先进mamba-like linear attention(MLLA)骨架之上,该骨架在图像处理任务中表现出色,同时提供快速推理速度。此外,我们引入了多阶段训练策略,以确保稳定性并提升模型的整体性能。仿真结果表明,我们提出的方法在感知质量方面显著优于现有方法。
英文摘要:
Recent advances in deep learning-based joint source-channel coding (DJSCC) have shown promise for end-to-end semantic image transmission. However, most existing schemes primarily focus on optimizing pixel-wise metrics, which often fail to align with human perception, leading to lower perceptual quality. In this letter, we propose a novel generative DJSCC approach using conditional diffusion models to enhance the perceptual quality of transmitted images. Specifically, by utilizing entropy models, we effectively manage transmission bandwidth based on the estimated entropy of transmitted sym-bols. These symbols are then used at the receiver as conditional information to guide a conditional diffusion decoder in image reconstruction. Our model is built upon the emerging advanced mamba-like linear attention (MLLA) skeleton, which excels in image processing tasks while also offering fast inference speed. Besides, we introduce a multi-stage training strategy to ensure the stability and improve the overall performance of the model. Simulation results demonstrate that our proposed method significantly outperforms existing approaches in terms of perceptual quality.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。