通过基于摘要统计的阈值设定增强使用自编码器的联邦异常检测
Enhanced Federated Anomaly Detection Through Autoencoders Using Summary Statistics-Based Thresholding
AI总结:
针对联邦学习中非独立同分布数据下的异常检测难题,提出一种利用正常与异常数据摘要统计信息聚合计算全局阈值的自编码器方法,有效提升了检测准确性与鲁棒性。
摘要:
在联邦学习(FL)中,由于数据的去中心化特性和非独立同分布(non-IID)数据分布的存在,异常检测(AD)是一项具有挑战性的任务。本研究引入了一种新颖的联邦阈值计算方法,该方法利用来自正常和异常数据的摘要统计信息,以提高在联邦环境下使用自编码器(AE)进行异常检测的准确性和鲁棒性。我们的方法聚合了各客户端的局部摘要统计信息,以计算一个全局阈值,该阈值能够最优地将异常数据与正常数据分离,同时确保隐私保护。我们使用公开可用的数据集,包括 Credit Card Fraud Detection、Shuttle 和 Covertype,在各种数据分布场景下进行了广泛的实验。结果表明,我们的方法始终优于现有的联邦和局部阈值计算技术,特别是在处理非独立同分布数据分布方面。本研究还探讨了不同数据分布场景和客户端数量对联邦异常检测性能的影响。我们的发现突出了利用摘要统计信息进行阈值计算在提高联邦异常检测系统的可扩展性和准确性方面的潜力。
英文摘要:
In Federated Learning (FL), anomaly detection (AD) is a challenging task due to the decentralized nature of data and the presence of non-IID data distributions. This study introduces a novel federated threshold calculation method that leverages summary statistics from both normal and anomalous data to improve the accuracy and robustness of anomaly detection using autoencoders (AE) in a federated setting. Our approach aggregates local summary statistics across clients to compute a global threshold that optimally separates anomalies from normal data while ensuring privacy preservation. We conducted extensive experiments using publicly available datasets, including Credit Card Fraud Detection, Shuttle, and Covertype, under various data distribution scenarios. The results demonstrate that our method consistently outperforms existing federated and local threshold calculation techniques, particularly in handling non-IID data distributions. This study also explores the impact of different data distribution scenarios and the number of clients on the performance of federated anomaly detection. Our findings highlight the potential of using summary statistics for threshold calculation in improving the scalability and accuracy of federated anomaly detection systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。