In this paper, we propose a novel distributed learning scheme, named group-based split federated learning (GSFL), to speed up artificial intelligence (AI) model training. Specifically, the GSFL operates in a split-then-federated manner, which consists of three steps: 1) Model distribution, in which the access point (AP) splits the AI models and distributes the client-side models to clients; 2) Model training, in which each client executes forward propagation and transmit the smashed data to the edge server. The edge server executes forward and backward propagation and then returns the gradient to the clients for updating local client-side models; and 3) Model aggregation, in which edge servers aggregate the server-side and client-side models. Simulation results show that the GSFL outperforms vanilla split learning and federated learning schemes in terms of overall training latency while achieving satisfactory accuracy.
Analysis and Optimization of Wireless Multimodal Federated Learning on Modal Heterogeneity
Shanghai Jiao Tong University(上海交通大学);Southeast University(东南大学);Data61, CSIRO(CSIRO数据61);Singapore University of Technology and Design(新加坡科技设计大学);Nanjing University of Science and Technology(南京理工大学);Jiangnan University(江南大学)
Joint Optimization for Federated Learning and Transmission over Unreliable Wireless Networks with Heterogeneous Data
Beijing University of Posts and Telecommunications(北京邮电大学);Jiaxing University(嘉兴学院);Northwestern Polytechnical University(西北工业大学);Southeast University(东南大学)
Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directions
Pennsylvania State University(宾夕法尼亚州立大学);Fudan University(复旦大学)
联合学习(Federated Learning,FL)和分裂学习(Split Learning,SL)是两种新兴的协作学习方法,可以极大地促进物联网(Internet of Things,IoT)中的泛在智能。联邦学习使使用私有数据本地训练的机器学习(ML)模型能够聚合成全局模型。拆分学习允许ML模型的不同部分在学习框架中的不同工作者上进行协作训练。联邦学习和分裂学习各有其独特的优势和各自的局限性,可以相互补充,共同实现物联网中的泛在智能。因此,联邦学习和分裂学习的结合成为近年来一个活跃的研究领域,引起了广泛的兴趣。在本文中,我们回顾了联邦学习和分离学习的最新发展,并对在基于边缘计算的物联网环境中结合这两种学习方法的最新技术进行了调查。我们还确定了一些开放的问题,并讨论了在这一领域的未来研究的可能方向,希望进一步引起研究界对这一新兴领域的兴趣。
Lightweight Federated Learning over Wireless Edge Networks
Department of Electronic Engineering, Tsinghua University(电子工程系,清华大学);School of Cyber Science and Technology, Beihang University(信息科学与技术学院,北航);Tsinghua Space Center, Tsinghua University(清华大学空间中心);College of Computing and Data Science, Nanyang Technological University(计算与数据科学学院,南洋理工大学)
Adaptive Client Selection via Q-Learning-based Whittle Index in Wireless Federated Learning
Guangdong Prov./Zhuhai Key Lab of IRADS, Beijing Normal-Hong Kong Baptist University, Guangdong, P. R. China(广东/珠海IRADS实验室,北京师范大学-香港 Baptist大学,广东,中华人民共和国);College of Engineering, Carnegie Mellon University, Pittsburgh, PA, USA(工程学院,卡内基梅隆大学,匹兹堡,PA,美国);Department of Statistics, University of Oxford, 24-29 St Giles', Oxford OX1 3LB, U.K.(统计学系,牛津大学,牛津OX1 3LB,英国)
Robust Federated Learning in Unreliable Wireless Networks: A Client Selection Approach
School of Computer Science, Nanjing University of Posts and Telecommunications(南京邮电大学计算机科学学院);School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)人工智能学院);Shenzhen Research Institute of Big Data(深圳大数据研究院)
Dual-Segment Clustering Strategy for Hierarchical Federated Learning in Heterogeneous Wireless Environments
College of Electronics and Information Engineering, Tongji University(同济大学电子与信息工程学院);Tongji Hospital, Tongji University(同济大学附属同济医院);Data61, CSIRO(澳大利亚联邦科学与工业研究组织Data61研究院);Guangzhou Huatu Information Technology Co., Ltd.(广州华图信息技术有限公司);School of Electrical and Computer Engineering, The University of Sydney(悉尼大学电气与计算机工程学院)
Analysis and Optimization of Wireless Federated Learning with Data Heterogeneity
Shanghai Jiao Tong University(上海交通大学);Nanjing University of Science and Technology(南京理工大学);Data61, CSIRO(澳大利亚联邦科学与工业研究组织数据61研究所);Princeton University(普林斯顿大学)
Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation
The University of Sydney(悉尼大学);EPFL(洛桑联邦理工学院);Kyung Hee University(庆熙大学);Vietnam - Korea University of Information and Communication Technology, The University of Danang(岘港大学越韩信息与通信技术大学)
The Role of Federated Learning in a Wireless World with Foundation Models
Singapore University of Technology and Design(新加坡科技设计大学);Zhejiang University/University of Illinois Urbana-Champaign Institute(浙江大学-伊利诺伊大学厄巴纳-香槟分校联合研究院);National Mobile Communications Research Laboratory, Southeast University(东南大学移动通信国家重点实验室);National University of Singapore(新加坡国立大学)