A Comprehensive Survey of Federated Transfer Learning: Challenges, Methods and Applications
Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能研究院);School of Computer Science and Technology, Shandong University(山东大学计算机科学与技术学院);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);Beijing Academy of Blockchain and Edge Computing(北京区块链与边缘计算研究院)
Wei Guo, Fuzhen Zhuang, Xiao Zhang, Yiqi Tong, Jin Dong
Federated learning (FL) is a novel distributed machine learning paradigm that enables participants to collaboratively train a centralized model with privacy preservation by eliminating the requirement of data sharing. In practice, FL often involves multiple participants and requires the third party to aggregate global information to guide the update of the target participant. Therefore, many FL methods do not work well due to the training and test data of each participant may not be sampled from the same feature space and the same underlying distribution. Meanwhile, the differences in their local devices (system heterogeneity), the continuous influx of online data (incremental data), and labeled data scarcity may further influence the performance of these methods. To solve this problem, federated transfer learning (FTL), which integrates transfer learning (TL) into FL, has attracted the attention of numerous researchers. However, since FL enables a continuous share of knowledge among participants with each communication round while not allowing local data to be accessed by other participants, FTL faces many unique challenges that are not present in TL. In this survey, we focus on categorizing and reviewing the current progress on federated transfer learning, and outlining corresponding solutions and applications. Furthermore, the common setting of FTL scenarios, available datasets, and significant related research are summarized in this survey.
Differential Private Federated Transfer Learning for Mental Health Monitoring in Everyday Settings: A Case Study on Stress Detection
University of California, Irvine(加利福尼亚大学欧文分校);School of Nursing, University of California, Irvine(加利福尼亚大学欧文分校护理学院);Institute for Future Health, University of California, Irvine(加利福尼亚大学欧文分校未来健康研究所)
A Cross-City Federated Transfer Learning Framework: A Case Study on Urban Region Profiling
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);JD iCity, JD Technology(京东科技京东智联云);JD Intelligent Cities Research(京东智能城市研究院);Department of Civil and Environmental Engineering, Hong Kong University of Science and Technology(香港科技大学土木与环境工程系)
A Survey of Incremental Transfer Learning: Combining Peer-to-Peer Federated Learning and Domain Incremental Learning for Multicenter Collaboration
University Hospital Erlangen(埃尔朗根大学医院);Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学);Comprehensive Cancer Center Erlangen-EMN(埃尔朗根-EMN综合癌症中心);Bavarian Cancer Research Center(巴伐利亚癌症研究中心)
An Adaptive ML Framework for Power Converter Monitoring via Federated Transfer Learning
Corporate Research Center, ABB AB(ABB AB公司企业研究中心);Motion System Drives, ABB Oy(ABB Oy公司运动系统驱动部);Division of Electric Power and Energy Systems, KTH Royal Institute of Technology(KTH皇家理工学院电力与能源系统系)
FedHealth 2: Weighted Federated Transfer Learning via Batch Normalization for Personalized Healthcare
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Microsoft Research Asia(微软亚洲研究院)
FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare
Beijing Key Lab. of Mobile Computing and Pervasive Devices, Inst. of Computing Tech., CAS(中国科学院计算技术研究所北京移动计算与普适设备重点实验室);University of Chinese Academy of Sciences(中国科学院大学);Pengcheng Laboratory(鹏城实验室);Microsoft Research Asia(微软亚洲研究院)
Federated Transfer Learning for EEG Signal Classification
WeBank Co., Ltd.(微众银行);Hong Kong University of Science and Technology(香港科技大学);Southern University of Science and Technology(南方科技大学);Nanyang Technological University(南洋理工大学)
FTA-FTL: A Fine-Tuned Aggregation Federated Transfer Learning Scheme for Lithology Microscopic Image Classification
School of Computing, Macquarie University(麦考瑞大学计算学院);Institute of Computational Systems Biology, University of Hamburg(汉堡大学计算系统生物学研究所);Sahand University of Technology(萨汉德工业大学);Yasouj University(亚苏季大学);School of Computer, Data and Mathematical Sciences, Western Sydney University(西悉尼大学计算机、数据与数学学院)
FedCL-Ensemble Learning: A Framework of Federated Continual Learning with Ensemble Transfer Learning Enhanced for Alzheimer's MRI Classifications while Preserving Privacy
PFLlib: A Beginner-Friendly and Comprehensive Personalized Federated Learning Library and Benchmark
Shanghai Jiao Tong University(上海交通大学);Institute for AI Industry Research, Tsinghua University(清华大学人工智能产业研究院);Queen’s University Belfast(贝尔法斯特女王大学);Stevens Institute of Technology(史蒂文斯理工学院)
A Comprehensive Survey On Client Selections in Federated Learning
College of Computing and Information Technology, University of Doha for Science and Technology(多哈科技大学计算与信息技术学院);Electrical Engineering, Qatar University(卡塔尔大学电气工程系)
Overcoming Challenges of Partial Client Participation in Federated Learning : A Comprehensive Review
Department of Artificial Intelligence, Indian Institute of Technology Hyderabad, India(人工智能系,印度理工学院海得拉巴学院);Department of Computing Technologies, Swinburne University of Technology, Hawthorn, australia(计算技术系,斯威本技术大学 Hawthorn 分校);Department of Physics, Indian Institute of Technology Delhi, India(物理系,印度理工学院德里学院);Department of Energy Science and Engineering, Indian Institute of Technology Delhi, India(能源科学与工程系,印度理工学院德里学院);Department of Computer Science and Engineering, Indian Institute of Technology Hyderabad, India(计算机科学与工程系,印度理工学院海得拉巴学院)
Deep Transfer Hashing for Adaptive Learning on Federated Streaming Data
Faculty of Computer Science and Business Information Systems, TUAS Würzburg-Schweinfurt(维尔zburg-施魏因富应用科学大学计算机科学与商务信息系统学院);Faculty of Technology, Bielefeld University(比勒费尔德大学技术学院);Center for Artificial Intelligence and Robotics Würzburg(维尔zburg人工智能与机器人中心)
FLIP: Towards Comprehensive and Reliable Evaluation of Federated Prompt Learning
University of Macau(澳门大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Shenzhen University of Advanced Technology(深圳理工大学);DataStory Information Technology Co., Ltd.(数说信息科技有限公司)
FedAL: Black-Box Federated Knowledge Distillation Enabled by Adversarial Learning
School of Information Engineering, Guangdong University of Technology(广东工业大学信息工程学院);School of Data Science, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)数据科学学院);Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳市人工智能与机器人研究院)
OpenFed: A Comprehensive and Versatile Open-Source Federated Learning Framework
Meituan(美团);Bytedance Inc.(字节跳动公司);Tsinghua University(清华大学);University of Macau(澳门大学);State Key Lab of Computer Science, ISCAS(中国科学院软件研究所计算机科学国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学)