arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.03359cs.DCcs.SYeess.SY
收藏

面向联邦学习的近似无线通信

Approximate Wireless Communication for Federated Learning

Xiang Ma, Haijian Sun, Rose Qingyang Hu, Yi Qian

AI总结:

本文针对无线网络中误码影响联邦学习性能的问题,基于梯度有界性证明提出一种近似通信方案,通过新颖的浮点转二进制编码与QAM映射直接传输带误差的梯度,省去纠错码与重传,在达到相同学习性能时节省至少一半时间。

摘要:

本文提出了一种用于联邦学习(FL)模型聚合上行链路传输的近似无线通信方案。我们考虑了在无线网络中FL模型交换期间会暴露出误码的真实信道。我们的研究表明,模型传输期间的随机误码会显著影响FL性能。为了克服这一挑战,我们基于机器学习(ML)模型梯度在特定约束下是有界的数学与统计证明,提出了一种近似通信方案。这一界限使我们能够为梯度值的浮点转二进制表示及其QAM星座映射引入一种新颖的编码方案。此外,由于FL梯度具有容错性,当信道质量令人满意时,所提方案直接传输带有误差的梯度,消除了大量的纠错码和/或重传。直接收益包括更少的开销和更低的延迟。所提方案非常适合无线网络中资源受限的设备。通过仿真,我们表明所提方案能有效减少误码对FL性能的影响,并且在达到相同学习性能时,比带纠错和重传的传输节省至少一半的时间。此外,我们研究了采用格雷编码时高阶调制中误码保护机制的有效性,发现该方法显著提升了学习性能。

英文摘要:

This paper presents an approximate wireless communication scheme for federated learning (FL) model aggregation in the uplink transmission. We consider a realistic channel that reveals bit errors during FL model exchange in wireless networks. Our study demonstrates that random bit errors during model transmission can significantly affect FL performance. To overcome this challenge, we propose an approximate communication scheme based on the mathematical and statistical proof that machine learning (ML) model gradients are bounded under certain constraints. This bound enables us to introduce a novel encoding scheme for float-to-binary representation of gradient values and their QAM constellation mapping. Besides, since FL gradients are error-resilient, the proposed scheme simply delivers gradients with errors when the channel quality is satisfactory, eliminating extensive error-correcting codes and/or retransmission. The direct benefits include less overhead and lower latency. The proposed scheme is well-suited for resource-constrained devices in wireless networks. Through simulations, we show that the proposed scheme is effective in reducing the impact of bit errors on FL performance and saves at least half the time than transmission with error correction and retransmission to achieve the same learning performance. In addition, we investigated the effectiveness of bit protection mechanisms in high-order modulation when gray coding is employed and found that this approach considerably enhances learning performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑