arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2204.00843cs.DC
收藏

基于联邦Transformer的云制造隐私保护异常检测

Privacy-preserving Anomaly Detection in Cloud Manufacturing via Federated Transformer

Shiyao Ma, Jiangtian Nie, Jiawen Kang, Lingjuan Lyu, Ryan Wen Liu, Ruihui Zhao, Ziyao Liu, Dusit Niyato

摘要:

随着云制造的快速发展,以边缘计算为核心架构的工业生产得到了极大的发展。然而,边缘设备在工业生产中经常出现异常和故障。因此,及时准确地检测这些异常情况对于云制造至关重要。因此,一个简单的解决方案是边缘设备将数据上传到云端进行异常检测。然而,工业4.0对数据隐私和安全性提出了更高的要求,将数据从边缘设备直接上传到云端是不现实的。针对上述严峻挑战,本文定制了一个弱监督边缘计算异常检测框架,基于联邦学习的Transformer框架(\textit{FedAnomaly}),处理云制造中的异常检测问题。具体来说,我们引入了联邦学习(FL)框架,允许边缘设备与云协作训练异常检测模型,而不会影响隐私。为了提高框架的隐私性能,我们在上传的特征中添加了差分隐私噪声。为了进一步提高边缘设备提取异常特征的能力,我们使用Transformer来提取异常数据的特征表示。在此背景下,我们设计了一种新的协作学习协议,以促进FL和Transformer之间的高效协作。此外,广泛的案例研究四个基准数据集验证了所提出的框架的有效性。据我们所知,这是第一次将FL和Transformer集成在一起来处理云制造中的异常检测问题。

英文摘要:

With the rapid development of cloud manufacturing, industrial production with edge computing as the core architecture has been greatly developed. However, edge devices often suffer from abnormalities and failures in industrial production. Therefore, detecting these abnormal situations timely and accurately is crucial for cloud manufacturing. As such, a straightforward solution is that the edge device uploads the data to the cloud for anomaly detection. However, Industry 4.0 puts forward higher requirements for data privacy and security so that it is unrealistic to upload data from edge devices directly to the cloud. Considering the above-mentioned severe challenges, this paper customizes a weakly-supervised edge computing anomaly detection framework, i.e., Federated Learning-based Transformer framework (\textit{FedAnomaly}), to deal with the anomaly detection problem in cloud manufacturing. Specifically, we introduce federated learning (FL) framework that allows edge devices to train an anomaly detection model in collaboration with the cloud without compromising privacy. To boost the privacy performance of the framework, we add differential privacy noise to the uploaded features. To further improve the ability of edge devices to extract abnormal features, we use the Transformer to extract the feature representation of abnormal data. In this context, we design a novel collaborative learning protocol to promote efficient collaboration between FL and Transformer. Furthermore, extensive case studies on four benchmark data sets verify the effectiveness of the proposed framework. To the best of our knowledge, this is the first time integrating FL and Transformer to deal with anomaly detection problems in cloud manufacturing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑