Federated learning is a recently proposed distributed machine learning paradigm for privacy preservation, which has found a wide range of applications where data privacy is of primary concern. Meanwhile, neural architecture search has become very popular in deep learning for automatically tuning the architecture and hyperparameters of deep neural networks. While both federated learning and neural architecture search are faced with many open challenges, searching for optimized neural architectures in the federated learning framework is particularly demanding. This survey paper starts with a brief introduction to federated learning, including both horizontal, vertical, and hybrid federated learning. Then, neural architecture search approaches based on reinforcement learning, evolutionary algorithms and gradient-based are presented. This is followed by a description of federated neural architecture search that has recently been proposed, which is categorized into online and offline implementations, and single- and multi-objective search approaches. Finally, remaining open research questions are outlined and promising research topics are suggested.
State Key Laboratory of Networking and Switching Technology (BUPT)(网络与交换技术国家重点实验室(北京邮电大学));Key Lab of High Confidence Software Technologies (Peking University)(高可信软件技术重点实验室(北京大学))
University of Technology Sydney(悉尼科技大学);Macquarie University(麦考瑞大学);University of New Castle(纽卡斯尔大学);University of Porto(波尔图大学);Nanyang Technological University(南洋理工大学);University of Minnesota(明尼苏达大学)
A Comprehensive Survey On Client Selections in Federated Learning
College of Computing and Information Technology, University of Doha for Science and Technology(多哈科技大学计算与信息技术学院);Electrical Engineering, Qatar University(卡塔尔大学电气工程系)
A Comprehensive Survey of Federated Transfer Learning: Challenges, Methods and Applications
Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能研究院);School of Computer Science and Technology, Shandong University(山东大学计算机科学与技术学院);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);Beijing Academy of Blockchain and Edge Computing(北京区块链与边缘计算研究院)
A Survey on Federated Fine-tuning of Large Language Models
State Key Laboratory of IOTSC, University of Macau(物联网科学与技术国家重点实验室,澳门大学);University of Electronic Science and Technology of China(电子科技大学);The University of Hong Kong(香港大学);Hong Kong University of Science and Technology (Guangzhou)(香港理工大学(广州))
Towards Tailored Models on Private AIoT Devices: Federated Direct Neural Architecture Search
Brandeis University(布兰迪斯大学);Northeastern University(东北大学);Beihang University(北京航空航天大学);Shenzhen Research Institute of Big Data(深圳大数据研究院);Zhejiang University(浙江大学);University of Windsor(温莎大学)
Threats and Defenses in Federated Learning Life Cycle: A Comprehensive Survey and Challenges
School of Artificial Intelligence and Computer Science, Nantong University(人工智能与计算机科学学院,南通大学);School of Electrical and Computer Engineering, The University of Sydney(电气与计算机工程学院,悉尼大学);University of St Andrews(圣安德鲁大学)
Department of Computer, Control and Management Engineering, Sapienza University of Rome(罗马萨皮恩扎大学计算机、控制与管理工程系);Department of Computer Science, Sapienza University of Rome(罗马萨皮恩扎大学计算机科学系);Università della Svizzera Italiana(意大利瑞士大学)
When Federated Learning Meets Quantum Computing: Survey and Research Opportunities
Department of Computer Science and Engineering, BITS Pilani Dubai Campus(计算机科学与工程系,比斯帕尼迪拜校区);Department of Computer Science, Missouri University of Science and Technology(计算机科学系,密苏里科技大学)
A Survey on Federated Causal Discovery and Inference
School of Computer Science, Nanjing University of Posts and Telecommunications(南京邮电大学计算机学院);School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机与信息工程学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University(香港理工大学数据科学与人工智能系)
A Survey on Contribution Evaluation in Vertical Federated Learning
The Hong Kong University of Science and Technology(香港科技大学);Webank(微众银行);Peking University(北京大学);Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院)
Towards One-shot Federated Learning: Advances, Challenges, and Future Directions
Department of Electrical Engineering and Information Technology, University of Naples Federico II(那不勒斯费德里科二世大学电气工程与信息科技系);Department of Mathematics and Applications "R. Caccioppoli", University of Naples Federico II(那不勒斯费德里科二世大学数学与应用系);Department of Mathematics, Indian Institute of Technology Indore(印度理工学院Indore分校数学系)
Overcoming Challenges of Partial Client Participation in Federated Learning : A Comprehensive Review
Department of Artificial Intelligence, Indian Institute of Technology Hyderabad, India(人工智能系,印度理工学院海得拉巴学院);Department of Computing Technologies, Swinburne University of Technology, Hawthorn, australia(计算技术系,斯威本技术大学 Hawthorn 分校);Department of Physics, Indian Institute of Technology Delhi, India(物理系,印度理工学院德里学院);Department of Energy Science and Engineering, Indian Institute of Technology Delhi, India(能源科学与工程系,印度理工学院德里学院);Department of Computer Science and Engineering, Indian Institute of Technology Hyderabad, India(计算机科学与工程系,印度理工学院海得拉巴学院)
Federated Learning: A Cutting-Edge Survey of the Latest Advancements and Applications
Universitat Politecnica de Valencia(瓦伦西亚理工大学);University of Tehran(德黑兰大学);University of Houston(休斯顿大学);Nazarbayev University(纳扎尔巴耶夫大学);Coventry University(考文垂大学)