Distributed Deep Reinforcement Learning Based Gradient Quantization for Federated Learning Enabled Vehicle Edge Computing
School of Internet of Things Engineering, Wuxi Institute of Technology(物联网工程学院,无锡科技学院);School of Internet of Things Engineering, Jiangnan University(物联网工程学院,江南大学);Department of Electronic Engineering, Beijing National Research Center for Information Science and Technology, Tsinghua University(电子工程系,信息科学与技术国家研究中心,清华大学);Qualcomm(高通);School of Engineering, University of Kent(工程学院,肯特大学);Department of Electrical and Computer Engineering, Hong Kong University of Science and Technology (HKUST)(电气与计算机工程系,香港科技大学)
Cui Zhang, Wenjun Zhang, Qiong Wu, Pingyi Fan, Qiang Fan, Jiangzhou Wang, Khaled B. Letaief
Federated Learning (FL) can protect the privacy of the vehicles in vehicle edge computing (VEC) to a certain extent through sharing the gradients of vehicles' local models instead of local data. The gradients of vehicles' local models are usually large for the vehicular artificial intelligence (AI) applications, thus transmitting such large gradients would cause large per-round latency. Gradient quantization has been proposed as one effective approach to reduce the per-round latency in FL enabled VEC through compressing gradients and reducing the number of bits, i.e., the quantization level, to transmit gradients. The selection of quantization level and thresholds determines the quantization error, which further affects the model accuracy and training time. To do so, the total training time and quantization error (QE) become two key metrics for the FL enabled VEC. It is critical to jointly optimize the total training time and QE for the FL enabled VEC. However, the time-varying channel condition causes more challenges to solve this problem. In this paper, we propose a distributed deep reinforcement learning (DRL)-based quantization level allocation scheme to optimize the long-term reward in terms of the total training time and QE. Extensive simulations identify the optimal weighted factors between the total training time and QE, and demonstrate the feasibility and effectiveness of the proposed scheme.
Energy Efficient Federated Learning over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission
University of Houston(休斯顿大学);Beijing University of Posts and Telecommunications(北京邮电大学);University of Science and Technology of China(中国科学技术大学);University of Florida(佛罗里达大学)
On-demand Quantization for Green Federated Generative Diffusion in Mobile Edge Networks
School of Automation, Guangdong University of Technology(广东工业大学自动化学院);School of Electronics Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院);School of Software Engineering, Beijing Jiaotong University(北京交通大学软件学院)
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications(网络与交换技术国家重点实验室,北京邮电大学);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院);The Future Network of Intelligence Institute, The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳)未来智联网络研究院);School of Science and Engineering, The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳)理工学院)
FedAL: Black-Box Federated Knowledge Distillation Enabled by Adversarial Learning
School of Information Engineering, Guangdong University of Technology(广东工业大学信息工程学院);School of Data Science, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)数据科学学院);Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳市人工智能与机器人研究院)
DRL-Based Federated Self-Supervised Learning for Task Offloading and Resource Allocation in ISAC-Enabled Vehicle Edge Computing
School of Internet of Things Engineering, Jiangnan University(江南大学物联网工程学院);Department of Electronic Engineering, Beijing National Research Center for Information Science and Technology, Tsinghua University(清华大学信息科学与技术国家研究中心电子工程系);State Key Lab. of ISN and School of Telecommunications Engineering, Xidian University(西安电子科技大学信息与通信系统国家重点实验室和电信工程学院);Department of Electronic Engineering, Shanghai Jiao Tong University(上海交通大学电子工程系);Department of Electrical and Computer Engineering, the Hong Kong University of Science and Technology (HKUST)(香港科技大学电子与计算机工程系)
UVeQFed: Universal Vector Quantization for Federated Learning
Ben-Gurion University of the Negev(内盖夫本-古里安大学);Princeton University(普林斯顿大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Weizmann Institute of Science(魏茨曼科学研究所)
FedShift: Robust Federated Learning Aggregation Scheme in Resource Constrained Environment via Weight Shifting
Department of Electrical Engineering and Computer Science, University of Stavanger(电气工程与计算机科学系,斯塔万格大学);Department of Computer Convergence Software, Korea University(计算机融合软件系,韩国大学)
Federated Learning framework for LoRaWAN-enabled IIoT communication: A case study
Centre of Informatics and Systems of the University of Coimbra, CISUC(科英布拉大学信息与系统中心);University of Coimbra(科英布拉大学);Institute for Systems Engineering and Computers, INESC(系统工程与计算机研究所);Sul-Rio-Grandense Federal Institute (IFSUL)(南里奥格兰德联邦学院);Instituto de Telecomunicações(电信研究所);Polytechnic Institute of Coimbra(科英布拉理工学院);Coimbra Business School(科英布拉商学院);INESC Coimbra(科英布拉INESC)
Quantum Cloud and Distributed Systems (qCLOUDS) Lab, School of Computing and Information Systems, The University of Melbourne, Australia(量子云与分布式系统实验室,计算机与信息系统学院,墨尔本大学,澳大利亚);Department of Computer Science and Engineering, University of Visvesvaraya College of Engineering, Bangalore University, India(计算机科学与工程系,维萨瓦拉亚工程学院,班加罗尔大学,印度)
HAFLQ: Heterogeneous Adaptive Federated LoRA Fine-tuned LLM with Quantization
Department of Engineering, King’s College London(伦敦国王学院工程系);Advanced Technology Group, Ericsson Inc.(爱立信公司先进科技组);Institute for Digital Communication, Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔兰根-纽伦堡弗里德里希-亚历山大大学数字通信研究所)
Enhancing Convergence, Privacy and Fairness for Wireless Personalized Federated Learning: Quantization-Assisted Min-Max Fair Scheduling
School of Information and Communication Engineering, Beijing University of Posts and Telecommunications(信息与通信工程学院,北京邮电大学);School of Computing, Macquarie University(计算学院,麦考瑞大学);Department of Broadband Communication, Peng Cheng Laboratory(宽带通信部,鹏城实验室);China Telecom, Sichuan Branch(中国电信四川分公司)
Spiking Personalized Federated Learning for Brain-Computer Interface-Enabled Immersive Communication
School of Electrical and Data Engineering, University of Technology Sydney(悉尼技术大学电气与数据工程学院);Thrust of Internet of Things, The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州)物联网研究所)