基于解耦扩散多帧补偿的无线视频语义通信
Wireless Video Semantic Communication with Decoupled Diffusion Multi-frame Compensation
AI总结：
提出WVSC-D无线视频语义通信框架，通过语义帧编码、参考帧替代运动向量及解耦扩散多帧补偿降低开销，实现语义级视频传输，PSNR较DVSC提升约1.8 dB。
摘要：
现有无线视频传输方案直接在像素级进行视频编码，忽略了视频中蕴含的内在语义。本文提出了一种带有解耦扩散多帧补偿（DDMFC）的无线视频语义通信框架，简称WVSC-D，将语义通信思想引入无线视频传输场景。WVSC-D首先将原始视频帧编码为语义帧，然后基于这种紧凑表示进行视频编码，实现语义级而非像素级的视频编码。此外，为进一步降低通信开销，引入参考语义帧替代常见视频编码方法中每帧的运动向量。在接收端，提出DDMFC，通过两阶段条件扩散过程生成补偿的当前语义帧。通过参考帧传输和DDMFC帧补偿，在保证视频传输性能的同时提升了带宽效率。实验结果验证了WVSC-D相比其他基于深度学习的方法（如DVSC）在PSNR上约1.8 dB的性能增益。
英文摘要：
Existing wireless video transmission schemes directly conduct video coding in pixel level, while neglecting the inner semantics contained in videos. In this paper, we propose a wireless video semantic communication framework with decoupled diffusion multi-frame compensation (DDMFC), abbreviated as WVSC-D, which integrates the idea of semantic communication into wireless video transmission scenarios. WVSC-D first encodes original video frames as semantic frames and then conducts video coding based on such compact representations, enabling the video coding in semantic level rather than pixel level. Moreover, to further reduce the communication overhead, a reference semantic frame is introduced to substitute motion vectors of each frame in common video coding methods. At the receiver, DDMFC is proposed to generate compensated current semantic frame by a two-stage conditional diffusion process. With both the reference frame transmission and DDMFC frame compensation, the bandwidth efficiency improves with satisfying video transmission performance. Experimental results verify the performance gain of WVSC-D over other DL-based methods e.g. DVSC about 1.8 dB in terms of PSNR.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
