arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.13043cs.CR
收藏

INTELLECT: 适应异构计算环境的网络威胁检测

INTELLECT: Adapting Cyber Threat Detection to Heterogeneous Computing Environments

University of Genova(热那亚大学);Fondazione Bruno Kessler(布鲁诺·凯斯勒基金会);IBM Research Europe(IBM欧洲研究院)

Simone Magnani, Liubov Nedoshivina, Roberto Doriguzzi-Corin, Stefano Braghin, Domenico Siracusa

AI总结:

INTELLECT通过整合特征选择、模型剪枝和微调技术,动态适应预训练ML模型以适应异构计算环境中的网络威胁检测。

摘要:

云计算、边缘计算和物联网的广泛应用增加了网络威胁的攻击面。这主要是由于大规模部署了往往不安全、异构的设备,这些设备具有不同的硬件和软件配置。这些设备的多样性吸引了各种潜在的攻击方法,使单个组织难以全面了解所有可能的威胁。在此背景下,通过联合学习结合不同方的数据可以开发出强大的异常检测模型(IDS)。联合学习使可以在不披露敏感训练数据(如网络流量或传感器读数)的情况下协作开发基于机器学习的IDS。然而,部署这些模型可能具有挑战性,因为它们可能需要比目标设备可用的计算资源更多的资源,尤其是当目标设备容量有限或已被其他操作占用时。由于训练设备特定的模型对组织来说不可行,因为训练数据的大部分是其他FL参与者私有的。为了解决这些挑战,本文提出INTELLECT,这是一种新的解决方案,将特征选择、模型剪枝和微调技术整合到一个统一的流程中,用于预训练ML模型和IDS配置的动态适应。通过实证评估,我们分析了INTELLECT方法在定制ML模型以适应组织设备的特定资源限制方面的效益,并测量了特征选择、剪枝和微调操作对流量分类准确率变化的影响。此外,我们展示了在微调过程中整合知识蒸馏技术的优势,使ML模型能够一致地适应本地网络模式,同时保持历史知识。

英文摘要:

The widespread adoption of cloud computing, edge, and IoT has increased the attack surface for cyber threats. This is due to the large-scale deployment of often unsecured, heterogeneous devices with varying hardware and software configurations. The diversity of these devices attracts a wide array of potential attack methods, making it challenging for individual organizations to have comprehensive knowledge of all possible threats. In this context, powerful anomaly detection models can be developed by combining data from different parties using Federated Learning. FL enables the collaborative development of ML-based IDSs without requiring the parties to disclose sensitive training data, such as network traffic or sensor readings. However, deploying the resulting models can be challenging, as they may require more computational resources than those available on target devices with limited capacity or already allocated for other operations. Training device-specific models is not feasible for an organization because a significant portion of the training data is private to other participants in the FL process. To address these challenges, this paper introduces INTELLECT, a novel solution that integrates feature selection, model pruning, and fine-tuning techniques into a cohesive pipeline for the dynamic adaptation of pre-trained ML models and configurations for IDSs. Through empirical evaluation, we analyze the benefits of INTELLECT's approach in tailoring ML models to the specific resource constraints of an organization's devices and measure variations in traffic classification accuracy resulting from feature selection, pruning, and fine-tuning operations. Additionally, we demonstrate the advantages of incorporating knowledge distillation techniques while fine-tuning, enabling the ML model to consistently adapt to local network patterns while preserving historical knowledge.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑