AI 中文总结
本文针对现有JSCC模型固定率运行、存储开销大的问题,提出FD-JSCC框架,集成HGAM、RSRM和CFPM,在触觉振动通信中实现灵活率传输,存储需求降低61.1%,性能与固定率基线相当,具备应用潜力。
AI 中文摘要
多媒体系统中实时触觉通信需求的增长,暴露了现有联合信源信道编码(JSCC)技术的局限性。当前JSCC模型虽支持端到端优化,但通常在固定编码率下运行,且不同率设置需单独的模型实例,这导致显著的存储开销和对动态带宽条件的适应性受限。为应对这些挑战,本文提出面向触觉振动信号的灵活深度联合信源信道编码(FD-JSCC)框架,其支持灵活速率传输且无需模型切换。FD-JSCC集成了灵活速率编解码器,该编解码器由分层增益适配模块(HGAM)和可切换速率残差模块(RSRM)增强,通过选择性保留关键触觉振动特征实现感知比特率压缩。此外,本文引入信道特征处理模块(CFPM),其利用实时信噪比(SNR)信息提升对信道噪声和信号衰减的鲁棒性。在IEEE 1918.1.1触觉振动数据集上训练后,FD-JSCC的重建性能可与固定速率基线(如DeepSC-S)相当,且在支持四种速率时存储需求降低61.1%。这些结果凸显了其在下一代网络中实现可扩展、低延迟触觉通信的潜力。
英文摘要
The increasing demand for real-time tactile communication in multimedia systems has exposed the limitations of existing Joint Source-Channel Coding (JSCC) techniques. While current JSCC models facilitate end-to-end optimization, they typically operate at fixed coding rates and require separate model instances for different rate settings. This results in significant storage overhead and limited adaptability to dynamic bandwidth conditions. To address these challenges, we propose the Flexible Deep Joint Source-Channel Coding (FD-JSCC) framework for vibrotactile signals, which supports flexible-rate transmission without the need for model switching. The FD-JSCC integrates a flexible-rate encoder-decoder enhanced with Hierarchical Gain Adaptation Module (HGAM) and Rate-Switchable Residual Module (RSRM), enabling bitrate-aware compression by selectively preserving salient vibrotactile features. Additionally, we introduce a Channel Feature Processing Module (CFPM), which leverages real-time SNR information to enhance robustness against channel noise and signal degradation. Trained on the IEEE 1918.1.1 vibrotactile dataset, FD-JSCC achieves reconstruction performance comparable to fixed-rate baselines (e.g., DeepSC-S), while reducing storage requirements by 61.1\% when supporting four rates. These results underscore its potential for scalable, low-latency tactile communication in next-generation networks.