arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.08096eess.AScs.SD
收藏

面向语音转文本传输的语义MIMO系统

Semantic MIMO Systems for Speech-to-Text Transmission

Imperial College London(帝国理工学院);Tsinghua University(清华大学);Jinan University(暨南大学);The Hong Kong University of Science and Technology(香港科技大学);Peng Cheng Laboratory(鹏城实验室)

Zhenzi Weng, Zhijin Qin, Huiqiang Xie, Xiaoming Tao, Khaled B. Letaief

AI总结:

本研究针对单用户及多用户MIMO场景,提出语义感知语音转文本传输系统SAC-ST,通过transformer生成低维语义特征、语义感知网络保障关键信息恢复,结合神经网络信道估计降低对完美信道信息的依赖,在低信噪比下性能优于传统方案。

摘要:

语义通信通过传输与任务相关的语义信息而非比特,已被用于执行众多智能任务。本文针对单用户多输入多输出(MIMO)和多用户MIMO通信场景,提出了一种语义感知的语音转文本传输系统,命名为SAC-ST。具体而言,本文首先设计了一种在接收端服务于语音转文本任务的语义通信系统,该系统利用transformer模块压缩语义信息并生成低维语义特征。此外,本文提出了一种新型语义感知网络,通过识别关键语义信息并保证其准确恢复,实现高语义保真度的传输。进一步地,我们为SAC-ST扩展了一个基于神经网络的信道估计网络,以降低对精确信道状态信息的依赖,并验证SAC-ST在实际通信环境中的可行性。仿真结果表明,在MIMO信道上的语音转文本传输中,所提出的SAC-ST在语音转文本指标上优于无语义感知网络的通信框架,尤其是在低信噪比 regime 下。此外,搭载所开发信道估计网络的SAC-ST性能与拥有完美信道状态信息的SAC-ST相当。

英文摘要:

Semantic communications have been utilized to execute numerous intelligent tasks by transmitting task-related semantic information instead of bits. In this article, we propose a semantic-aware speech-to-text transmission system for the single-user multiple-input multiple-output (MIMO) and multi-user MIMO communication scenarios, named SAC-ST. Particularly, a semantic communication system to serve the speech-to-text task at the receiver is first designed, which compresses the semantic information and generates the low-dimensional semantic features by leveraging the transformer module. In addition, a novel semantic-aware network is proposed to facilitate transmission with high semantic fidelity by identifying the critical semantic information and guaranteeing its accurate recovery. Furthermore, we extend the SAC-ST with a neural network-enabled channel estimation network to mitigate the dependence on accurate channel state information and validate the feasibility of SAC-ST in practical communication environments. Simulation results will show that the proposed SAC-ST outperforms the communication framework without the semantic-aware network for speech-to-text transmission over the MIMO channels in terms of the speech-to-text metrics, especially in the low signal-to-noise regime. Moreover, the SAC-ST with the developed channel estimation network is comparable to the SAC-ST with perfect channel state information.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑