arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2208.03369eess.SP
收藏

大规模多输入多输出CSI反馈的空间可分离注意机制

A Spatially Separable Attention Mechanism for massive MIMO CSI Feedback

Sharan Mourya, SaiDhiraj Amuru, Kiran Kumar Kuchi

摘要:

信道状态信息(CSI)反馈在通过波束成形实现更高增益方面起着至关重要的作用。然而,对于大规模多输入多输出系统,该反馈开销是巨大的并且随着天线的数量线性增长。为了减少反馈开销,近年来实现了几种压缩感知(CS)技术,但是这些技术通常是迭代的,并且在功率受限的用户设备(UE)中实现起来在计算上是复杂的。因此,近年来,基于数据的深度学习方法接管了CSI压缩,引入了各种神经网络。具体而言,基于变压器的网络已被证明可以实现最先进的性能。然而,在Transformers的核心处的多头注意操作在计算上是复杂的,使得Transformers难以在UE上实现。在这项工作中,我们提出了一个轻量级的Transformer命名为STNet,它使用了空间可分离的注意力机制,是显着复杂性低于传统的全注意力。配备了这一点,STNet在某些情况下超过了最先进的模型,大约有$1/10^{th}$的资源。

英文摘要:

Channel State Information (CSI) Feedback plays a crucial role in achieving higher gains through beamforming. However, for a massive MIMO system, this feedback overhead is huge and grows linearly with the number of antennas. To reduce the feedback overhead several compressive sensing (CS) techniques were implemented in recent years but these techniques are often iterative and are computationally complex to realize in power-constrained user equipment (UE). Hence, a data-based deep learning approach took over in these recent years introducing a variety of neural networks for CSI compression. Specifically, transformer-based networks have been shown to achieve state-of-the-art performance. However, the multi-head attention operation, which is at the core of transformers, is computationally complex making transformers difficult to implement on a UE. In this work, we present a lightweight transformer named STNet which uses a spatially separable attention mechanism that is significantly less complex than the traditional full-attention. Equipped with this, STNet outperformed state-of-the-art models in some scenarios with approximately $1/10^{th}$ of the resources.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑