arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.01138cs.ITeess.SPmath.IT
收藏

无线图像传输中面向语义引导扩散的深度联合信源信道编码

Semantics-Guided Diffusion for Deep Joint Source-Channel Coding in Wireless Image Transmission

Maojun Zhang, Haotian Wu, Guangxu Zhu, Richeng Jin, Xiaoming Chen, Deniz Gündüz

AI总结:

本文提出语义引导扩散深度联合信源信道编码(SGD-JSCC),利用文本描述或边缘图等语义信息引导扩散去噪过程,并实现对慢衰落和快衰落信道条件的自适应,在极差信道条件下仍优于现有DeepJSCC方案。

摘要:

联合信源信道编码(JSCC)通过将信源和信道统计特性联合纳入系统设计,为提高传输效率提供了一条有前景的途径。该领域的一项关键进展是深度联合信源信道编码(DeepJSCC)技术,该技术设计了由神经网络参数化的输入信号到信道符号的直接映射,可以针对任意信道模型和语义质量指标进行训练。本文将DeepJSCC框架推进为一种语义对齐、高保真的传输方法,称为语义引导扩散DeepJSCC(SGD-JSCC)。现有将扩散模型(DMs)与JSCC结合的方案在将随机生成转化为精确重建以及适应变化的信道条件方面面临挑战。SGD-JSCC包含两项关键创新:(1)利用一些有助于图像语义的固有信息,例如文本描述或边缘图,来引导扩散去噪过程;(2)借助语义引导的DM进行信道去噪,实现对变化信道条件的无缝自适应。该DM由多样化的语义信息引导,并与DeepJSCC无缝集成。在慢衰落信道中,SGD-JSCC根据直接从信道输出估计的瞬时信噪比(SNR)动态自适应,从而无需额外的导频传输进行信道估计。在快衰落信道中,我们引入了一种免训练的去噪策略,使SGD-JSCC能够有效适应信道增益的波动。数值结果表明,在语义信息的引导下并利用强大的DM,我们的方法优于现有的DeepJSCC方案,即使在极差的信道条件下也能提供令人满意的重建性能。

英文摘要:

Joint source-channel coding (JSCC) offers a promising avenue for enhancing transmission efficiency by jointly incorporating source and channel statistics into the system design. A key advancement in this area is the deep joint source and channel coding (DeepJSCC) technique that designs a direct mapping of input signals to channel symbols parameterized by a neural network, which can be trained for arbitrary channel models and semantic quality metrics. This paper advances the DeepJSCC framework toward a semantics-aligned, high-fidelity transmission approach, called semantics-guided diffusion DeepJSCC (SGD-JSCC). Existing schemes that integrate diffusion models (DMs) with JSCC face challenges in transforming random generation into accurate reconstruction and adapting to varying channel conditions. SGD-JSCC incorporates two key innovations: (1) utilizing some inherent information that contributes to the semantics of an image, such as text description or edge map, to guide the diffusion denoising process; and (2) enabling seamless adaptability to varying channel conditions with the help of a semantics-guided DM for channel denoising. The DM is guided by diverse semantic information and integrates seamlessly with DeepJSCC. In a slow fading channel, SGD-JSCC dynamically adapts to the instantaneous signal-to-noise ratio (SNR) directly estimated from the channel output, thereby eliminating the need for additional pilot transmissions for channel estimation. In a fast fading channel, we introduce a training-free denoising strategy, allowing SGD-JSCC to effectively adjust to fluctuations in channel gains. Numerical results demonstrate that, guided by semantic information and leveraging the powerful DM, our method outperforms existing DeepJSCC schemes, delivering satisfactory reconstruction performance even at extremely poor channel conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑