arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.03575cs.LG
收藏

深度强化学习辅助的联邦学习算法在IIoT数据管理中的应用

Deep Reinforcement Learning Assisted Federated Learning Algorithm for Data Management of IIoT

China University of Petroleum (East China)(中国石油大学(华东));Tsinghua University(清华大学);University of Houston(休斯顿大学)

Peiying Zhang, Chao Wang, Chunxiao Jiang, Zhu Han

摘要:

工业物联网(IIoT)规模的不断扩大,导致IIoT设备每时每刻都在产生海量的用户数据。根据终端用户的不同需求,这些数据通常具有高度的异构性和隐私性,而大多数用户不愿意将其公开。如何在工业物联网领域以高效和安全的方式管理这些时间序列数据仍然是一个悬而未决的问题,因此引起了学术界和工业界的广泛关注。联邦学习(FL)作为一种新的机器学习范式,在训练异构和私有数据方面具有很大的优势。本文研究了FL技术在无线网络环境下管理IIoT设备数据的应用。为了提高模型聚合率和降低通信成本,我们将深度强化学习(DRL)应用于IIoT设备选择过程,具体来说就是选择那些模型准确的IIoT设备节点。因此,我们提出了一种DRL辅助的FL算法,可以兼顾IIoT设备数据训练的隐私性和效率。通过分析IIoT设备的数据特征,我们使用MNIST、Fashion MNIST和CIFAR-10数据集来表示IIoT产生的数据。实验中,采用深度神经网络(DNN)模型对数据进行训练,实验结果表明,准确率可达97%以上,验证了该算法的有效性。

英文摘要:

The continuous expanded scale of the industrial Internet of Things (IIoT) leads to IIoT equipments generating massive amounts of user data every moment. According to the different requirement of end users, these data usually have high heterogeneity and privacy, while most of users are reluctant to expose them to the public view. How to manage these time series data in an efficient and safe way in the field of IIoT is still an open issue, such that it has attracted extensive attention from academia and industry. As a new machine learning (ML) paradigm, federated learning (FL) has great advantages in training heterogeneous and private data. This paper studies the FL technology applications to manage IIoT equipment data in wireless network environments. In order to increase the model aggregation rate and reduce communication costs, we apply deep reinforcement learning (DRL) to IIoT equipment selection process, specifically to select those IIoT equipment nodes with accurate models. Therefore, we propose a FL algorithm assisted by DRL, which can take into account the privacy and efficiency of data training of IIoT equipment. By analyzing the data characteristics of IIoT equipments, we use MNIST, fashion MNIST and CIFAR-10 data sets to represent the data generated by IIoT. During the experiment, we employ the deep neural network (DNN) model to train the data, and experimental results show that the accuracy can reach more than 97\%, which corroborates the effectiveness of the proposed algorithm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑