arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.02318cs.LGcs.DBcs.DC
收藏

PeFAD:一种用于时间序列异常检测的参数高效联邦框架

PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detection

Central South University(中南大学);Aalborg University(奥尔堡大学);University of Illinois at Chicago(伊利诺伊大学芝加哥分校)

Ronghui Xu, Hao Miao, Senzhang Wang, Philip S. Yu, Jianxin Wang

AI总结:

PeFAD提出了一种参数高效的联邦时间序列异常检测框架,首次将预训练语言模型作为客户端本地模型主体,通过异常驱动掩码选择、小规模参数微调和共享隐私数据集上的知识蒸馏,在降低通信与适配成本的同时解决数据异质性问题,并在四个真实数据集上最高超越现有方法28.74%。

摘要:

随着移动感知技术的普及,海量时间序列数据在各个领域被生成和积累,推动了大量实际应用的发展。在此背景下,时间序列异常检测具有重要的实际意义,它致力于从时间序列的正常样本分布中识别出偏离样本。现有方法通常假设所有时间序列数据都集中在一个中心位置可用。然而,由于各种边缘设备的部署,我们正在见证时间序列数据的分散化收集。为了弥合分散的时间序列数据与集中式异常检测算法之间的差距,并考虑到日益增长的隐私关切,我们提出了一种名为PeFAD的参数高效联邦异常检测框架。PeFAD首次采用预训练语言模型(PLM)作为客户端本地模型的主体,从而能够受益于其跨模态知识迁移能力。为了降低通信开销和本地模型适配成本,我们提出了一种参数高效的联邦训练模块,使得客户端只需微调小规模参数并将其传输到服务器进行更新。PeFAD利用一种新颖的异常驱动掩码选择策略,以减轻训练过程中被忽略的异常的影响。我们还提出了一种在合成隐私保护数据集上的知识蒸馏操作,该数据集由所有客户端共享,以解决客户端之间的数据异质性问题。我们在四个真实数据集上进行了广泛评估,PeFAD的性能优于现有最先进的基线方法,最高提升达28.74%。

英文摘要:

With the proliferation of mobile sensing techniques, huge amounts of time series data are generated and accumulated in various domains, fueling plenty of real-world applications. In this setting, time series anomaly detection is practically important. It endeavors to identify deviant samples from the normal sample distribution in time series. Existing approaches generally assume that all the time series is available at a central location. However, we are witnessing the decentralized collection of time series due to the deployment of various edge devices. To bridge the gap between the decentralized time series data and the centralized anomaly detection algorithms, we propose a Parameter-efficient Federated Anomaly Detection framework named PeFAD with the increasing privacy concerns. PeFAD for the first time employs the pre-trained language model (PLM) as the body of the client's local model, which can benefit from its cross-modality knowledge transfer capability. To reduce the communication overhead and local model adaptation cost, we propose a parameter-efficient federated training module such that clients only need to fine-tune small-scale parameters and transmit them to the server for update. PeFAD utilizes a novel anomaly-driven mask selection strategy to mitigate the impact of neglected anomalies during training. A knowledge distillation operation on a synthetic privacy-preserving dataset that is shared by all the clients is also proposed to address the data heterogeneity issue across clients. We conduct extensive evaluations on four real datasets, where PeFAD outperforms existing state-of-the-art baselines by up to 28.74%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑