Federated learning (FL) has been recognized as a viable distributed learning paradigm for training a machine learning model across distributed clients without uploading raw data. However, FL in wireless networks still faces two major challenges, i.e., large communication overhead and high energy consumption, which are exacerbated by client heterogeneity in dataset sizes and wireless channels. While model quantization is effective for energy reduction, existing works ignore adapting quantization to heterogeneous clients and FL convergence. To address these challenges, this paper develops an energy optimization problem of jointly designing quantization levels, scheduling clients, allocating channels, and controlling computation frequencies (QCCF) in wireless FL. Specifically, we derive an upper bound identifying the influence of client scheduling and quantization errors on FL convergence. Under the longterm convergence constraints and wireless constraints, the problem is established and transformed into an instantaneous problem with Lyapunov optimization. Solving Karush-Kuhn-Tucker conditions, our closed-form solution indicates that the doubly adaptive quantization level rises with the training process and correlates negatively with dataset sizes. Experiment results validate our theoretical results, showing that QCCF consumes less energy with faster convergence compared with state-of-the-art baselines.
Analysis and Optimization of Wireless Multimodal Federated Learning on Modal Heterogeneity
Shanghai Jiao Tong University(上海交通大学);Southeast University(东南大学);Data61, CSIRO(CSIRO数据61);Singapore University of Technology and Design(新加坡科技设计大学);Nanjing University of Science and Technology(南京理工大学);Jiangnan University(江南大学)
Joint Optimization for Federated Learning and Transmission over Unreliable Wireless Networks with Heterogeneous Data
Beijing University of Posts and Telecommunications(北京邮电大学);Jiaxing University(嘉兴学院);Northwestern Polytechnical University(西北工业大学);Southeast University(东南大学)
Lightweight Federated Learning over Wireless Edge Networks
Department of Electronic Engineering, Tsinghua University(电子工程系,清华大学);School of Cyber Science and Technology, Beihang University(信息科学与技术学院,北航);Tsinghua Space Center, Tsinghua University(清华大学空间中心);College of Computing and Data Science, Nanyang Technological University(计算与数据科学学院,南洋理工大学)
Adaptive Client Selection via Q-Learning-based Whittle Index in Wireless Federated Learning
Guangdong Prov./Zhuhai Key Lab of IRADS, Beijing Normal-Hong Kong Baptist University, Guangdong, P. R. China(广东/珠海IRADS实验室,北京师范大学-香港 Baptist大学,广东,中华人民共和国);College of Engineering, Carnegie Mellon University, Pittsburgh, PA, USA(工程学院,卡内基梅隆大学,匹兹堡,PA,美国);Department of Statistics, University of Oxford, 24-29 St Giles', Oxford OX1 3LB, U.K.(统计学系,牛津大学,牛津OX1 3LB,英国)
Robust Federated Learning in Unreliable Wireless Networks: A Client Selection Approach
School of Computer Science, Nanjing University of Posts and Telecommunications(南京邮电大学计算机科学学院);School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)人工智能学院);Shenzhen Research Institute of Big Data(深圳大数据研究院)
Dual-Segment Clustering Strategy for Hierarchical Federated Learning in Heterogeneous Wireless Environments
College of Electronics and Information Engineering, Tongji University(同济大学电子与信息工程学院);Tongji Hospital, Tongji University(同济大学附属同济医院);Data61, CSIRO(澳大利亚联邦科学与工业研究组织Data61研究院);Guangzhou Huatu Information Technology Co., Ltd.(广州华图信息技术有限公司);School of Electrical and Computer Engineering, The University of Sydney(悉尼大学电气与计算机工程学院)
Analysis and Optimization of Wireless Federated Learning with Data Heterogeneity
Shanghai Jiao Tong University(上海交通大学);Nanjing University of Science and Technology(南京理工大学);Data61, CSIRO(澳大利亚联邦科学与工业研究组织数据61研究所);Princeton University(普林斯顿大学)
Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation
The University of Sydney(悉尼大学);EPFL(洛桑联邦理工学院);Kyung Hee University(庆熙大学);Vietnam - Korea University of Information and Communication Technology, The University of Danang(岘港大学越韩信息与通信技术大学)
The Role of Federated Learning in a Wireless World with Foundation Models
Singapore University of Technology and Design(新加坡科技设计大学);Zhejiang University/University of Illinois Urbana-Champaign Institute(浙江大学-伊利诺伊大学厄巴纳-香槟分校联合研究院);National Mobile Communications Research Laboratory, Southeast University(东南大学移动通信国家重点实验室);National University of Singapore(新加坡国立大学)