arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.03438cs.ITcs.LGeess.SPmath.IT

CSI-GPT:融合联邦调优的生成式预训练Transformer实现下行大规模MIMO信道获取

CSI-GPT: Integrating Generative Pre-Trained Transformer with Federated-Tuning to Acquire Downlink Massive MIMO Channels

School of Information and Electronics, Beijing Institute of Technology(北京理工大学信息与电子学院);King Abdulaziz University(阿卜杜勒阿齐兹国王大学);School of Electronics and Computer Science, University of Southampton(南安普顿大学电子与计算机科学学院);Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)(穆罕默德·本·扎耶德人工智能大学)

Ye Zeng, Li Qiao, Zhen Gao, Tong Qin, Zhonghuai Wu, Emad Khalaf, Sheng Chen, Mohsen Guizani

AI总结:

提出CSI-GPT方法,融合生成式预训练Transformer与联邦调优,实现低开销高效的下行大规模MIMO信道获取,并通过仿真验证其优势。

摘要:

在大规模多输入多输出(MIMO)系统中,如何以低开销可靠地获取下行信道状态信息(CSI)是一项挑战。在本工作中,通过将生成式预训练Transformer(GPT)与联邦调优相结合,我们提出了一种CSI-GPT方法,以实现高效的下行CSI获取。具体而言,我们首先提出了一种基于Swin Transformer的信道获取网络(SWTCAN)来获取下行CSI,其中导频信号、下行信道估计和上行CSI反馈被联合设计。此外,为解决训练数据不足的问题,我们提出了一种基于变分自编码器的信道样本生成器(VAE-CSG),它能够基于从当前小区获得的有限数量的高质量CSI数据生成足够的CSI样本。由VAE-CSG生成的CSI数据集将用于预训练SWTCAN。为了对预训练的SWTCAN进行微调以提升性能,我们提出了一种在线联邦调优方法,其中仅解冻并利用空中计算更新少量SWTCAN参数,避免了将用户设备(UE)的完整CSI样本聚合到基站进行集中式微调所带来的高通信开销。仿真结果验证了所提出的SWTCAN的优势以及所提出的联邦调优方法的通信效率。我们的代码可在https://github.com/BIT-ZY/CSI-GPT公开获取。

英文摘要:

In massive multiple-input multiple-output (MIMO) systems, how to reliably acquire downlink channel state information (CSI) with low overhead is challenging. In this work, by integrating the generative pre-trained Transformer (GPT) with federated-tuning, we propose a CSI-GPT approach to realize efficient downlink CSI acquisition. Specifically, we first propose a Swin Transformer-based channel acquisition network (SWTCAN) to acquire downlink CSI, where pilot signals, downlink channel estimation, and uplink CSI feedback are jointly designed. Furthermore, to solve the problem of insufficient training data, we propose a variational auto-encoder-based channel sample generator (VAE-CSG), which can generate sufficient CSI samples based on a limited number of high-quality CSI data obtained from the current cell. The CSI dataset generated from VAE-CSG will be used for pre-training SWTCAN. To fine-tune the pre-trained SWTCAN for improved performance, we propose an online federated-tuning method, where only a small amount of SWTCAN parameters are unfrozen and updated using over-the-air computation, avoiding the high communication overhead caused by aggregating the complete CSI samples from user equipment (UEs) to the BS for centralized fine-tuning. Simulation results verify the advantages of the proposed SWTCAN and the communication efficiency of the proposed federated-tuning method. Our code is publicly available at https://github.com/BIT-ZY/CSI-GPT

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑