College of Computer Science and Engineering, Northeastern University(计算机科学与工程学院,东北大学);Distributed Systems Group, TU Wien(分布式系统组,TU Wien);College of Software, Northeastern University(软件学院,东北大学);College of Information Science and Engineering, Northeastern University(信息科学与工程学院,东北大学)
Machine learning typically relies on the assumption that training and testing distributions are identical and that data is centrally stored for training and testing. However, in real-world scenarios, distributions may differ significantly and data is often distributed across different devices, organizations, or edge nodes. Consequently, it is imperative to develop models that can effectively generalize to unseen distributions where data is distributed across different domains. In response to this challenge, there has been a surge of interest in federated domain generalization (FDG) in recent years. FDG combines the strengths of federated learning (FL) and domain generalization (DG) techniques to enable multiple source domains to collaboratively learn a model capable of directly generalizing to unseen domains while preserving data privacy. However, generalizing the federated model under domain shifts is a technically challenging problem that has received scant attention in the research area so far. This paper presents the first survey of recent advances in this area. Initially, we discuss the development process from traditional machine learning to domain adaptation and domain generalization, leading to FDG as well as provide the corresponding formal definition. Then, we categorize recent methodologies into four classes: federated domain alignment, data manipulation, learning strategies, and aggregation optimization, and present suitable algorithms in detail for each category. Next, we introduce commonly used datasets, applications, evaluations, and benchmarks. Finally, we conclude this survey by providing some potential research topics for the future.
Federated Continual Learning via Knowledge Fusion: A Survey
Nanyang Technological University(南洋理工大学);JD iCity, JD Technology(京东科技京东智城);JD Intelligent Cities Research & Institute of Artificial Intelligence, Southwest Jiaotong University(西南交通大学京东智慧城市研究院与人工智能研究所);School of Computing and Artificial Intelligence, Southwest Jiaotong University(西南交通大学计算机与人工智能学院)
Federated Domain Generalization with Latent Space Inversion
Ying Wu College of Computing, New Jersey Institute of Technology, USA(yingwu计算学院,新泽西理工学院,美国);Applied Artificial Intelligence Initiative Deakin University(应用人工智能计划,德克萨斯大学)
FedSDAF: Leveraging Source Domain Awareness for Enhanced Federated Domain Generalization
School of Computer Science and Technology, Huazhong University of Science and Technology(华中科技大学计算机科学与技术学院);School of Software Engineering, Huazhong University of Science and Technology(华中科技大学软件工程学院);School of Computer Science and Technology, Tiangong University(天津工业大学计算机科学与技术学院)
A Comprehensive Survey of Federated Transfer Learning: Challenges, Methods and Applications
Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能研究院);School of Computer Science and Technology, Shandong University(山东大学计算机科学与技术学院);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);Beijing Academy of Blockchain and Edge Computing(北京区块链与边缘计算研究院)
A Survey on Federated Fine-tuning of Large Language Models
State Key Laboratory of IOTSC, University of Macau(物联网科学与技术国家重点实验室,澳门大学);University of Electronic Science and Technology of China(电子科技大学);The University of Hong Kong(香港大学);Hong Kong University of Science and Technology (Guangzhou)(香港理工大学(广州))
A Survey of Incremental Transfer Learning: Combining Peer-to-Peer Federated Learning and Domain Incremental Learning for Multicenter Collaboration
University Hospital Erlangen(埃尔朗根大学医院);Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学);Comprehensive Cancer Center Erlangen-EMN(埃尔朗根-EMN综合癌症中心);Bavarian Cancer Research Center(巴伐利亚癌症研究中心)
Pre-Training and Personalized Fine-Tuning via Over-the-Air Federated Meta-Learning: Convergence-Generalization Trade-Offs
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Department of ECE, The Hong Kong University of Science and Technology(香港科学与技术大学电子工程系);Department of Engineering, King’s College London(伦敦国王学院工程系)
A Survey of Personalized Federated Foundation Models for Privacy-Preserving Recommendation
Australian Artificial Intelligence Institute, University of Technology Sydney(澳大利亚人工智能研究所,悉尼技术大学);College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);School of Computer Science and Technology, Beijing Jiaotong University(北京交通大学计算机科学与技术学院);Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University(香港理工大学数据科学与人工智能系)
Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR)(山东大学-南洋理工大学人工智能国际联合研究院(C-FAIR));Software School, Shandong University(山东大学软件学院);Shandong University(山东大学);Sino-Singapore International Joint Research Institute(中新国际联合研究院);Alibaba-NTU Singapore Joint Research Institute(阿里巴巴-新加坡南洋理工大学联合研究学院);Nanyang Technological University(南洋理工大学);Microsoft Research Asia(微软亚洲研究院)
A Survey on Vertical Federated Learning: From a Layered Perspective
Hong Kong University of Science and Technology(香港科技大学);Clustar Co., Ltd(Clustar有限公司);Peking University(北京大学);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
OledFL: Unleashing the Potential of Decentralized Federated Learning via Opposite Lookahead Enhancement
National University of Defense Technology(国防科技大学);Hebei University of Technology(河北工业大学);School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区网络空间科学与技术学院)
University of Technology Sydney(悉尼科技大学);Macquarie University(麦考瑞大学);University of New Castle(纽卡斯尔大学);University of Porto(波尔图大学);Nanyang Technological University(南洋理工大学);University of Minnesota(明尼苏达大学)
The Paradox of Noise: An Empirical Study of Noise-Infusion Mechanisms to Improve Generalization, Stability, and Privacy in Federated Learning
Data Science and Analytics Institute, University of Oklahoma(俄克拉荷马大学数据科学与分析研究所);Industrial and Systems Engineering, University of Oklahoma(俄克拉荷马大学工业与系统工程系)
Synergizing Foundation Models and Federated Learning: A Survey
Uppsala University(乌普萨拉大学);University College London(伦敦大学学院);University of Liverpool(利物浦大学);Eindhoven University of Technology(埃因霍温理工大学);The University of Hong Kong(香港大学);Research Institutes of Sweden(瑞典研究机构)