arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2011.09144cs.NI
收藏

基于机器学习的网络入侵检测系统的NetFlow数据集

NetFlow Datasets for Machine Learning-based Network Intrusion Detection Systems

Mohanad Sarhan, Siamak Layeghy, Nour Moustafa, Marius Portmann

摘要:

基于机器学习(ML)的网络入侵检测系统(NIDS)已被证明是保护网络免受网络攻击的可靠智能工具。网络数据特征对基于ML的网络入侵检测系统的性能有很大的影响。然而,评估ML模型通常并不可靠,因为每个支持ML的NIDS都是使用可能不包含安全事件的不同数据特征进行训练和验证的。因此,需要多个数据集的共同基础特征集来评估ML模型的检测准确性及其跨数据集泛化的能力。本文介绍了四个基准NIDS数据集(UNSW-NB 15,BoT-IoT,ToN-IoT和CSE-CIC-IDS 2018)的NetFlow功能,使用其公开的数据包捕获文件。在实际场景中,与原始数据集中使用的复杂特征相比,NetFlow特征相对更容易从网络流量中提取,因为它们通常从数据包报头中提取。生成的Netflow数据集被标记为解决基于二进制和多类的学习挑战。初步结果表明,NetFlow功能导致类似的二进制类的结果和较低的多类分类结果之间的四个数据集相比,其各自的原始功能数据集。NetFlow数据集被命名为NF-UNSW-NB 15,NF-BoT-IoT,NF-ToN-IoT,NF-CSE-CIC-IDS 2018和NF-UQ-NIDS,发布在http://staff.itee.uq.edu.au/marius/NIDS_datasets/上用于研究目的。

英文摘要:

Machine Learning (ML)-based Network Intrusion Detection Systems (NIDSs) have proven to become a reliable intelligence tool to protect networks against cyberattacks. Network data features has a great impact on the performances of ML-based NIDSs. However, evaluating ML models often are not reliable, as each ML-enabled NIDS is trained and validated using different data features that may do not contain security events. Therefore, a common ground feature set from multiple datasets is required to evaluate an ML model's detection accuracy and its ability to generalise across datasets. This paper presents NetFlow features from four benchmark NIDS datasets known as UNSW-NB15, BoT-IoT, ToN-IoT, and CSE-CIC-IDS2018 using their publicly available packet capture files. In a real-world scenario, NetFlow features are relatively easier to extract from network traffic compared to the complex features used in the original datasets, as they are usually extracted from packet headers. The generated Netflow datasets have been labelled for solving binary- and multiclass-based learning challenges. Preliminary results indicate that NetFlow features lead to similar binary-class results and lower multi-class classification results amongst the four datasets compared to their respective original features datasets. The NetFlow datasets are named NF-UNSW-NB15, NF-BoT-IoT, NF-ToN-IoT, NF-CSE-CIC-IDS2018 and NF-UQ-NIDS are published at http://staff.itee.uq.edu.au/marius/NIDS_datasets/ for research purposes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑