arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2203.05232cs.CR
收藏

网络入侵检测系统中机器学习算法的评价

Evaluation of Machine Learning Algorithms in Network-Based Intrusion Detection System

Tuan-Hong Chua, Iftekhar Salam

摘要:

网络安全已成为企业关注的焦点之一。随着互联网使用的持续增长,网络攻击的数量不断增加。入侵检测系统(IDS)是一种帮助检测网络攻击的警报系统。随着新型网络攻击的不断出现,研究人员专注于开发基于机器学习(ML)的IDS来检测零日攻击。研究人员在评估IDS检测零日攻击的性能时,通常从训练数据集中删除部分或全部攻击样本,只将它们包含在测试数据集中。虽然这种方法可以显示IDS检测未知攻击的能力;但是,它不能反映IDS的长期性能,因为它只显示攻击类型的变化。在本文中,我们专注于评估基于ML的IDS的长期性能。为了实现这一目标,我们建议评估ML为基础的IDS使用的数据集,创建晚于训练数据集。该方法可以更好地评估基于ML的IDS的长期性能,因为测试数据集反映了攻击类型的变化和网络基础设施随时间的变化。我们已经实现了六种用于IDS的最流行的ML模型,包括决策树(DT),随机森林(RF),支持向量机(SVM),朴素贝叶斯(NB),人工神经网络(ANN)和深度神经网络(DNN)。我们使用CIC-IDS 2017和CSE-CIC-IDS 2018数据集进行的实验表明,SVM和ANN最能抵抗过拟合。此外,我们的实验结果还表明,DT和RF受到过拟合的影响最大,尽管它们在训练数据集上表现良好。另一方面,我们使用LUFlow数据集的实验表明,当训练数据集和测试数据集之间的差异很小时,所有模型都可以表现良好。

英文摘要:

Cybersecurity has become one of the focuses of organisations. The number of cyberattacks keeps increasing as Internet usage continues to grow. An intrusion detection system (IDS) is an alarm system that helps to detect cyberattacks. As new types of cyberattacks continue to emerge, researchers focus on developing machine learning (ML) based IDS to detect zero-day attacks. Researchers usually remove some or all attack samples from the training dataset and only include them in the testing dataset when evaluating the performance of an IDS on detecting zero-day attacks. Although this method may show the ability of an IDs to detect unknown attacks; however, it does not reflect the long-term performance of the IDS as it only shows the changes in the type of attacks. In this paper, we focus on evaluating the long-term performance of ML based IDS. To achieve this goal, we propose evaluating the ML-based IDS using a dataset that is created later than the training dataset. The proposed method can better assess the long-term performance of an ML-based IDS, as the testing dataset reflects the changes in the type of attack and the changes in network infrastructure over time. We have implemented six of the most popular ML models that are used for IDS, including decision tree (DT), random forest (RF), support vector machine (SVM), naïve Bayes (NB), artificial neural network (ANN) and deep neural network (DNN). Our experiments using the CIC-IDS2017 and the CSE-CIC-IDS2018 datasets show that SVM and ANN are most resistant to overfitting. Besides that, our experiment results also show that DT and RF suffer the most from overfitting, although they perform well on the training dataset. On the other hand, our experiments using the LUFlow dataset have shown that all models can perform well when the difference between the training and testing datasets is small.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑