arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.05868cs.DC
收藏

从联邦学习到联邦神经结构搜索:综述

From Federated Learning to Federated Neural Architecture Search: A Survey

Hangyu Zhu, Haoyu Zhang, Yaochu Jin

摘要:

联邦学习是最近提出的分布式机器学习隐私保护的范例,它已经发现了广泛的应用,其中数据隐私是主要关注。同时,神经架构搜索在深度学习中已经变得非常流行,用于自动调整深度神经网络的架构和超参数。虽然联邦学习和神经架构搜索都面临着许多开放的挑战,但在联邦学习框架中搜索优化的神经架构尤其苛刻。这篇调查论文首先简要介绍了联邦学习,包括水平、垂直和混合联邦学习。然后,提出了基于强化学习、进化算法和基于梯度的神经网络结构搜索方法。接下来是最近提出的联邦神经架构搜索的描述,它被分类为在线和离线实现,以及单目标和多目标搜索方法。最后,剩余的开放研究问题的概述和有前途的研究课题提出了建议。

英文摘要:

Federated learning is a recently proposed distributed machine learning paradigm for privacy preservation, which has found a wide range of applications where data privacy is of primary concern. Meanwhile, neural architecture search has become very popular in deep learning for automatically tuning the architecture and hyperparameters of deep neural networks. While both federated learning and neural architecture search are faced with many open challenges, searching for optimized neural architectures in the federated learning framework is particularly demanding. This survey paper starts with a brief introduction to federated learning, including both horizontal, vertical, and hybrid federated learning. Then, neural architecture search approaches based on reinforcement learning, evolutionary algorithms and gradient-based are presented. This is followed by a description of federated neural architecture search that has recently been proposed, which is categorized into online and offline implementations, and single- and multi-objective search approaches. Finally, remaining open research questions are outlined and promising research topics are suggested.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑