arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.03090cs.LG
收藏

模块化联邦学习

Modular Federated Learning

Scania CV AB(斯堪尼亚商用车有限公司)

Kuo-Yun Liang, Abhishek Srinivasan, Juan Carlos Andresen

摘要:

联邦学习是一种在网络边缘上训练机器学习模型的方法,尽可能接近产生数据的地方,其动机是无法流式传输和集中存储边缘设备产生的大量数据以及数据隐私问题。这种学习范式需要鲁棒的算法来解决设备异构性和数据异构性。本文提出了ModFL作为一个联邦学习框架,将模型分为一个配置模块和一个操作模块,使联邦学习的各个模块。这种模块化的方法使得从一组异构设备以及从其用户产生的非IID数据中提取知识成为可能。这种方法可以被视为具有个性化层的联邦学习的扩展FedPer框架,它解决了数据异构性。我们使用CNN证明了ModFL在CIFAR-10和STL-10的非IID数据分区上优于FedPer。我们对使用RNN的HAPT,RWHAR和WISDM数据集的时间序列数据的结果仍然不确定,我们认为所选择的数据集并没有突出ModFL的优势,但在最坏的情况下,它的表现与FedPer一样好。

英文摘要:

Federated learning is an approach to train machine learning models on the edge of the networks, as close as possible where the data is produced, motivated by the emerging problem of the inability to stream and centrally store the large amount of data produced by edge devices as well as by data privacy concerns. This learning paradigm is in need of robust algorithms to device heterogeneity and data heterogeneity. This paper proposes ModFL as a federated learning framework that splits the models into a configuration module and an operation module enabling federated learning of the individual modules. This modular approach makes it possible to extract knowlege from a group of heterogeneous devices as well as from non-IID data produced from its users. This approach can be viewed as an extension of the federated learning with personalisation layers FedPer framework that addresses data heterogeneity. We show that ModFL outperforms FedPer for non-IID data partitions of CIFAR-10 and STL-10 using CNNs. Our results on time-series data with HAPT, RWHAR, and WISDM datasets using RNNs remain inconclusive, we argue that the chosen datasets do not highlight the advantages of ModFL, but in the worst case scenario it performs as well as FedPer.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑