This paper presents an approximate wireless communication scheme for federated learning (FL) model aggregation in the uplink transmission. We consider a realistic channel that reveals bit errors during FL model exchange in wireless networks. Our study demonstrates that random bit errors during model transmission can significantly affect FL performance. To overcome this challenge, we propose an approximate communication scheme based on the mathematical and statistical proof that machine learning (ML) model gradients are bounded under certain constraints. This bound enables us to introduce a novel encoding scheme for float-to-binary representation of gradient values and their QAM constellation mapping. Besides, since FL gradients are error-resilient, the proposed scheme simply delivers gradients with errors when the channel quality is satisfactory, eliminating extensive error-correcting codes and/or retransmission. The direct benefits include less overhead and lower latency. The proposed scheme is well-suited for resource-constrained devices in wireless networks. Through simulations, we show that the proposed scheme is effective in reducing the impact of bit errors on FL performance and saves at least half the time than transmission with error correction and retransmission to achieve the same learning performance. In addition, we investigated the effectiveness of bit protection mechanisms in high-order modulation when gray coding is employed and found that this approach considerably enhances learning performance.
The Role of Federated Learning in a Wireless World with Foundation Models
Singapore University of Technology and Design(新加坡科技设计大学);Zhejiang University/University of Illinois Urbana-Champaign Institute(浙江大学-伊利诺伊大学厄巴纳-香槟分校联合研究院);National Mobile Communications Research Laboratory, Southeast University(东南大学移动通信国家重点实验室);National University of Singapore(新加坡国立大学)
Joint Optimization for Federated Learning and Transmission over Unreliable Wireless Networks with Heterogeneous Data
Beijing University of Posts and Telecommunications(北京邮电大学);Jiaxing University(嘉兴学院);Northwestern Polytechnical University(西北工业大学);Southeast University(东南大学)
Analysis and Optimization of Wireless Multimodal Federated Learning on Modal Heterogeneity
Shanghai Jiao Tong University(上海交通大学);Southeast University(东南大学);Data61, CSIRO(CSIRO数据61);Singapore University of Technology and Design(新加坡科技设计大学);Nanjing University of Science and Technology(南京理工大学);Jiangnan University(江南大学)
Lightweight Federated Learning over Wireless Edge Networks
Department of Electronic Engineering, Tsinghua University(电子工程系,清华大学);School of Cyber Science and Technology, Beihang University(信息科学与技术学院,北航);Tsinghua Space Center, Tsinghua University(清华大学空间中心);College of Computing and Data Science, Nanyang Technological University(计算与数据科学学院,南洋理工大学)
Adaptive Client Selection via Q-Learning-based Whittle Index in Wireless Federated Learning
Guangdong Prov./Zhuhai Key Lab of IRADS, Beijing Normal-Hong Kong Baptist University, Guangdong, P. R. China(广东/珠海IRADS实验室,北京师范大学-香港 Baptist大学,广东,中华人民共和国);College of Engineering, Carnegie Mellon University, Pittsburgh, PA, USA(工程学院,卡内基梅隆大学,匹兹堡,PA,美国);Department of Statistics, University of Oxford, 24-29 St Giles', Oxford OX1 3LB, U.K.(统计学系,牛津大学,牛津OX1 3LB,英国)
Dual-Segment Clustering Strategy for Hierarchical Federated Learning in Heterogeneous Wireless Environments
College of Electronics and Information Engineering, Tongji University(同济大学电子与信息工程学院);Tongji Hospital, Tongji University(同济大学附属同济医院);Data61, CSIRO(澳大利亚联邦科学与工业研究组织Data61研究院);Guangzhou Huatu Information Technology Co., Ltd.(广州华图信息技术有限公司);School of Electrical and Computer Engineering, The University of Sydney(悉尼大学电气与计算机工程学院)
Analysis and Optimization of Wireless Federated Learning with Data Heterogeneity
Shanghai Jiao Tong University(上海交通大学);Nanjing University of Science and Technology(南京理工大学);Data61, CSIRO(澳大利亚联邦科学与工业研究组织数据61研究所);Princeton University(普林斯顿大学)
Robust Federated Learning in Unreliable Wireless Networks: A Client Selection Approach
School of Computer Science, Nanjing University of Posts and Telecommunications(南京邮电大学计算机科学学院);School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)人工智能学院);Shenzhen Research Institute of Big Data(深圳大数据研究院)
Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation
The University of Sydney(悉尼大学);EPFL(洛桑联邦理工学院);Kyung Hee University(庆熙大学);Vietnam - Korea University of Information and Communication Technology, The University of Danang(岘港大学越韩信息与通信技术大学)
FedFog: Network-Aware Optimization of Federated Learning over Wireless Fog-Cloud Systems
Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg(卢森堡大学安全、可靠性与信任跨学科中心(SnT));School of Electronics, Electrical Engineering and Computer Science, Queen’s University Belfast(贝尔法斯特女王大学电子、电气工程与计算机科学学院)