Latency Minimization for UAV-Enabled Federated Learning: Trajectory Design and Resource Allocation
Shenzhen Future Network of Intelligence Institute (FNii-Shenzhen)(深圳未来智能网络研究院);School of Science and Engineering (SSE)(科学与工程学院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shenzhen Institute of Advanced Technology (SIAT)(深圳先进技术研究院);Chinese Academy of Sciences (CAS)(中国科学院);Southern University of Science and Technology(南方科技大学);Imperial College London(伦敦帝国学院);Central South University(中南大学);Shenzhen University of Advanced Technology(深圳理工大学)
Federated learning (FL) has become a transformative paradigm for distributed machine learning across wireless networks. However, the performance of FL is often hindered by the unreliable communication links between resource-constrained Internet of Things (IoT) devices and the central server. To overcome this challenge, we propose a novel framework that employs an unmanned aerial vehicle (UAV) as a mobile server to enhance the FL training process. By capitalizing on the UAV's mobility, we establish strong line-of-sight connections with IoT devices, thereby enhancing communication reliability and capacity. To maximize training efficiency, we formulate a latency minimization problem that jointly optimizes bandwidth allocation, computing frequencies, transmit power for both the UAV and IoT devices, and the UAV's flight trajectory. Subsequently, we analyze the required rounds of the IoT devices training and the UAV aggregation for FL convergence. Based on the convergence constraint, we transform the problem into three subproblems and develop an efficient alternating optimization algorithm to solve this problem effectively. Additionally, we provide a thorough analysis of the algorithm's convergence and computational complexity. Extensive numerical results demonstrate that our proposed scheme not only surpasses existing benchmark schemes in reducing latency up to 15.29%, but also achieves training efficiency that nearly matches the ideal scenario.
Qatar University(卡塔尔大学);Qualcomm Inc(高通公司);Hamad Bin Khalifa University(哈马德·本·哈利法大学)
The usage of unmanned aerial vehicles (UAVs) in civil and military applications continues to increase due to the numerous advantages that they provide over conventional approaches. Despite the abundance of such advantages, it is imperative to investigate the performance of UAV utilization while considering their design limitations. This paper investigates the deployment of UAV swarms when each UAV carries a machine learning classification task. To avoid data exchange with ground-based processing nodes, a federated learning approach is adopted between a UAV leader and the swarm members to impro…
To prolong the lifetime of the unmanned aerial vehicles (UAVs), the UAVs need to fulfill their missions in the shortest possible time. In addition to this requirement, in many applications, the UAVs require a reliable internet connection during their flights. In this paper, we minimize the travel time of the UAVs, ensuring that a probabilistic connectivity constraint is satisfied. To solve this problem, we need a global model of the outage probability in the environment. Since the UAVs have different missions and fly over different areas, their collected data carry local information on the net…
This paper investigates the control of a massive population of UAVs such as drones. The straightforward method of control of UAVs by considering the interactions among them to make a flock requires a huge inter-UAV communication which is impossible to implement in real-time applications. One method of control is to apply the mean-field game (MFG) framework which substantially reduces communications among the UAVs. However, to realize this framework, powerful processors are required to obtain the control laws at different UAVs. This requirement limits the usage of the MFG framework for real-tim…
Heilongjiang University(黑龙江大学);Nanyang Technological University(南洋理工大学);Georgia Southern University(佐治亚南方大学);Alibaba Group(阿里巴巴集团);Alibaba-NTU Joint Research Institute(阿里巴巴-南洋理工大学联合研究院);Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly(南洋理工大学-不列颠哥伦比亚大学积极乐龄卓越联合研究中心)
Due to air quality significantly affects human health, it is becoming increasingly important to accurately and timely predict the Air Quality Index (AQI). To this end, this paper proposes a new federated learning-based aerial-ground air quality sensing framework for fine-grained 3D air quality monitoring and forecasting. Specifically, in the air, this framework leverages a light-weight Dense-MobileNet model to achieve energy-efficient end-to-end learning from haze features of haze images taken by Unmanned Aerial Vehicles (UAVs) for predicting AQI scale distribution. Furthermore, the Federated …
With the development and progress of science and technology, the Internet of Things(IoT) has gradually entered people's lives, bringing great convenience to our lives and improving people's work efficiency. Specifically, the IoT can replace humans in jobs that they cannot perform. As a new type of IoT vehicle, the current status and trend of research on Unmanned Aerial Vehicle(UAV) is gratifying, and the development prospect is very promising. However, privacy and communication are still very serious issues in drone applications. This is because most drones still use centralized cloud-based da…
Korean Southeast Center for the 4th Industrial Revolution Leader Education, Pusan National University(韩国釜山国立大学第四次工业革命领袖教育韩国东南中心);Laval University(拉瓦尔大学);College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机与软件学院);Kumoh National Institute of Technology(金乌工科大学);Department of Biomedical Convergence Engineering, Pusan National University(釜山国立大学生物医学融合工程系)
Federated learning (FL), invented by Google in 2016, has become a hot research trend. However, enabling FL in wireless networks has to overcome the limited battery challenge of mobile users. In this regard, we propose to apply unmanned aerial vehicle (UAV)-empowered wireless power transfer to enable sustainable FL-based wireless networks. The objective is to maximize the UAV transmit power efficiency, via a joint optimization of transmission time and bandwidth allocation, power control, and the UAV placement. Directly solving the formulated problem is challenging, due to the coupling of variab…
University of Hong Kong(香港大学);University of New South Wales(新南威尔士大学);Southern University of Science and Technology(南方科技大学)
Wireless federated learning (FL) is an emerging machine learning paradigm that trains a global parametric model from distributed datasets via wireless communications. This paper proposes a unit-modulus wireless FL (UMWFL) framework, which simultaneously uploads local model parameters and computes global model parameters via optimized phase shifting. The proposed framework avoids sophisticated baseband signal processing, leading to both low communication delays and implementation costs. A training loss bound is derived and a penalty alternating minimization (PAM) algorithm is proposed to minimi…
EURECOM(欧洲通信学院);Mitsubishi Electric R&D Centre Europe(三菱电机欧洲研发中心)
In this work, we investigate the problem of an online trajectory design for an Unmanned Aerial Vehicle (UAV) in a Federated Learning (FL) setting where several different communities exist, each defined by a unique task to be learned. In this setting, spatially distributed devices belonging to each community collaboratively contribute towards training their community model via wireless links provided by the UAV. Accordingly, the UAV acts as a mobile orchestrator coordinating the transmissions and the learning schedule among the devices in each community, intending to accelerate the learning pro…
National Yang Ming Chiao Tung University(国立阳明交通大学);Mississippi State University(密西西比州立大学);Texas Tech University(德克萨斯理工大学)
Federated learning (FL) is a promising distributed learning technique particularly suitable for wireless learning scenarios since it can accomplish a learning task without raw data transportation so as to preserve data privacy and lower network resource consumption. However, current works on FL over wireless networks do not profoundly study the fundamental performance of FL over wireless networks that suffers from communication outage due to channel impairment and network interference. To accurately exploit the performance of FL over wireless networks, this paper proposes a novel intermittent …
Virginia Tech(弗吉尼亚理工大学);University of Colorado Colorado Springs(科罗拉多大学科罗拉多斯普林斯分校);Ericsson Research(爱立信研究院);Princeton University(普林斯顿大学);University of Oulu(奥卢大学)
Unmanned aerial vehicle (UAV) swarms must exploit machine learning (ML) in order to execute various tasks ranging from coordinated trajectory planning to cooperative target recognition. However, due to the lack of continuous connections between the UAV swarm and ground base stations (BSs), using centralized ML will be challenging, particularly when dealing with a large volume of data. In this paper, a novel framework is proposed to implement distributed federated learning (FL) algorithms within a UAV swarm that consists of a leading UAV and several following UAVs. Each following UAV trains a l…
Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Shanghai Jiao Tong University(上海交通大学);Nanjing University(南京大学);The Hong Kong Polytechnic University(香港理工大学)
Unmanned aerial vehicles (UAVs), or say drones, are envisioned to support extensive applications in next-generation wireless networks in both civil and military fields. Empowering UAVs networks intelligence by artificial intelligence (AI) especially machine learning (ML) techniques is inevitable and appealing to enable the aforementioned applications. To solve the problems of traditional cloud-centric ML for UAV networks such as privacy concern, unacceptable latency, and resource burden, a distributed ML technique, \textit(i.e.), federated learning (FL), has been recently proposed to enable mu…
King’s College London(伦敦国王学院);Princeton University(普林斯顿大学);Shenzhen Research Institute of Big Data(深圳大数据研究院);The Chinese University of Hong Kong(香港中文大学);Virginia Tech(弗吉尼亚理工大学);Kyung Hee University(庆熙大学)
In this paper, the problem of delay minimization for federated learning (FL) over wireless communication networks is investigated. In the considered model, each user exploits limited local computational resources to train a local FL model with its collected data and, then, sends the trained FL model parameters to a base station (BS) which aggregates the local FL models and broadcasts the aggregated FL model back to all the users. Since FL involves learning model exchanges between the users and the BS, both computation and communication latencies are determined by the required learning accuracy…
Purdue University(普渡大学);University at Buffalo (SUNY)(纽约州立大学布法罗分校);Duke University(杜克大学)
We investigate training machine learning (ML) models across a set of geo-distributed, resource-constrained clusters of devices through unmanned aerial vehicles (UAV) swarms. The presence of time-varying data heterogeneity and computational resource inadequacy among device clusters motivate four key parts of our methodology: (i) stratified UAV swarms of leader, worker, and coordinator UAVs, (ii) hierarchical nested personalized federated learning (HN-PFL), a distributed ML framework for personalized model training across the worker-leader-core network hierarchy, (iii) cooperative UAV resource p…
Personalized Federated Learning by Energy-Efficient UAV Communications
Department of Computer Science, North Carolina State University(计算机科学系,北卡罗来纳州立大学);Department of Electrical and Computer Engineering, University of Massachusetts(电气与计算机工程系,马萨诸塞大学)
Jeonbuk National University(全北国立大学);Pukyong National University(釜庆国立大学)
This work studies federated learning (FL) over a fog radio access network, in which multiple internet-of-things (IoT) devices cooperatively learn a shared machine learning model by communicating with a cloud server (CS) through distributed access points (APs). Under the assumption that the fronthaul links connecting APs to CS have finite capacity, a rate-splitting transmission at IoT devices (IDs) is proposed which enables hybrid edge and cloud decoding of split uplink messages. The problem of completion time minimization for FL is tackled by optimizing the rate-splitting transmission and fron…
FedSCAM (Federated Sharpness-Aware Minimization with Clustered Aggregation and Modulation): Scam-resistant SAM for Robust Federated Optimization in Heterogeneous Environments
Department of Computer Science, Lahore University of Management Sciences, Lahore, Pakistan(计算机科学系,拉合尔管理科学大学,拉合尔,巴基斯坦)
University of South Florida(南佛罗里达大学);Mississippi State University(密西西比州立大学)
Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes efficient optimization difficult. To tackle this problem, many FL algorithms focus on mitigating the effects of data heterogeneity across clients by increasing the performance of the global model. However, almost all algorithms leverage Empirical Risk Minimization (ERM) to be the local optimizer, which is easy to make the global model fall into a sharp valley and…
Proximal Control of UAVs with Federated Learning for Human-Robot Collaborative Domains
Lab of Systems Engineering and Robotics (LASER), Department of Computer Systems, Universidade Federal da Paraiba(系统工程与机器人实验室(LASER),计算机系统系,巴伊帕巴联邦大学);Department of Cybernetics, Czech Technical University in Prague(控制论系,布拉格捷克技术大学)
Federated Learning is a modern decentralized machine learning technique where user equipments perform machine learning tasks locally and then upload the model parameters to a central server. In this paper, we consider a 3-layer hierarchical federated learning system which involves model parameter exchanges between the cloud and edge servers, and the edge servers and user equipment. In a hierarchical federated learning model, delay in communication and computation of model parameters has a great impact on achieving a predefined global model accuracy. Therefore, we formulate a joint learning and…
King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);Queen’s University(女王大学);University of Sharjah(沙迦大学)
Unmanned aerial vehicles (UAVs) mobility enables flexible and customized federated learning (FL) at the network edge. However, the underlying uncertainties in the aerial-terrestrial wireless channel may lead to a biased FL model. In particular, the distribution of the global model and the aggregation of the local updates within the FL learning rounds at the UAVs are governed by the reliability of the wireless channel. This creates an undesirable bias towards the training data of ground devices with better channel conditions, and vice versa. This paper characterizes the global bias problem of a…
Locally Estimated Global Perturbations are Better than Local Perturbations for Federated Sharpness-aware Minimization
Cooperative Medianet Innovation Center(合作中位数创新中心);Shanghai Jiao Tong University(上海交通大学);Shanghai AI Laboratory(上海人工智能实验室);RIKEN AIP(理化学研究所人工智能项目);The University of Tokyo(东京大学)
On Privacy-Preserving Image Transmission in Low-Altitude Networks: A Swin Transformer-Based Framework with Federated Learning
School of Electronics and Information, Northwestern Polytechnical University(电子工程学院,西北工业大学);DecoreX Intelligent Technologies Co., Ltd.(DecoreX智能科技有限公司);Samsung AI Center(三星人工智能中心);th Research Institute of China North Industries Group Corporation(中国北方工业集团208研究所);Department of Electrical and Computer Engineering, University of Houston(电子与计算机工程系,休斯顿大学)
Nanjing University of Posts and Telecommunications(南京邮电大学);University of Science and Technology Beijing(北京科技大学)
Since federated learning (FL) has been introduced as a decentralized learning technique with privacy preservation, statistical heterogeneity of distributed data stays the main obstacle to achieve robust performance and stable convergence in FL applications. Model personalization methods have been studied to overcome this problem. However, existing approaches are mainly under the prerequisite of fully labeled data, which is unrealistic in practice due to the requirement of expertise. The primary issue caused by partial-labeled condition is that, clients with deficient labeled data can suffer fr…
Heilongjiang University(黑龙江大学);Dalian Minzu University(大连民族大学);University College London(伦敦大学学院);Singapore University of Technology and Design(新加坡科技设计大学);Guangdong University of Technology(广东工业大学);Nanyang Technological University(南洋理工大学)
Air access networks have been recognized as a significant driver of various Internet of Things (IoT) services and applications. In particular, the aerial computing network infrastructure centered on the Internet of Drones has set off a new revolution in automatic image recognition. This emerging technology relies on sharing ground truth labeled data between Unmanned Aerial Vehicle (UAV) swarms to train a high-quality automatic image recognition model. However, such an approach will bring data privacy and data availability challenges. To address these issues, we first present a Semi-supervised …
University of Houston(休斯顿大学);Beijing University of Posts and Telecommunications(北京邮电大学);Purple Mountain Laboratories(紫金山实验室);The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳))
Federated learning (FL) over mobile devices has fostered numerous intriguing applications/services, many of which are delay-sensitive. In this paper, we propose a service delay efficient FL (SDEFL) scheme over mobile devices. Unlike traditional communication efficient FL, which regards wireless communications as the bottleneck, we find that under many situations, the local computing delay is comparable to the communication delay during the FL training process, given the development of high-speed wireless transmission techniques. Thus, the service delay in FL should be computing delay + communi…
Singapore University of Design and Technology(新加坡科技设计大学);East China Normal University(华东师范大学);Zhejiang University(浙江大学)
Personalized Federated Learning (PFL) is a new Federated Learning (FL) paradigm, particularly tackling the heterogeneity issues brought by various mobile user equipments (UEs) in mobile edge computing (MEC) networks. However, due to the ever-increasing number of UEs and the complicated administrative work it brings, it is desirable to switch the PFL algorithm from its conventional two-layer framework to a multiple-layer one. In this paper, we propose hierarchical PFL (HPFL), an algorithm for deploying PFL over massive MEC networks. The UEs in HPFL are divided into multiple clusters, and the UE…
Federated Learning (FL) has opened the opportunity for collaboratively training machine learning models on heterogeneous mobile or Edge devices while keeping local data private.With an increase in its adoption, a growing concern is related to its economic and environmental cost (as is also the case for other machine learning techniques).Unfortunately, little work has been done to optimize its energy consumption or emissions of carbon dioxide or equivalents, as energy minimization is usually left as a secondary objective.In this paper, we investigate the problem of minimizing the energy consump…
A Fast and Flat Federated Learning Method via Weighted Momentum and Sharpness-Aware Minimization
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));National University of Singapore(新加坡国立大学);Nanyang Technological University, Singapore(南洋理工大学,新加坡);Shenzhen University(深圳大学)
Federated Bayesian learning offers a principled framework for the definition of collaborative training algorithms that are able to quantify epistemic uncertainty and to produce trustworthy decisions. Upon the completion of collaborative training, an agent may decide to exercise her legal "right to be forgotten", which calls for her contribution to the jointly trained model to be deleted and discarded. This paper studies federated learning and unlearning in a decentralized network within a Bayesian framework. It specifically develops federated variational inference (VI) solutions based on the d…
Federated Motor Imagery Classification for Privacy-Preserving Brain-Computer Interfaces
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院);Shenzhen Huazhong University of Science and Technology Research Institute(华中科技大学深圳研究院);School of Civil and Hydraulic Engineering, Huazhong University of Science and Technology(华中科技大学土木与水利工程学院)