arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.05067cs.CR
收藏

UNSW-NB15计算机安全数据集:通过可视化进行分析

UNSW-NB15 Computer Security Dataset: Analysis through Visualization

Zeinab Zoghi, Gursel Serpen

摘要:

本文介绍了UNSW-NB 25计算机网络安全或入侵检测数据集的可视化分析,以检测该数据集固有的任何问题,这些问题可能需要研究人员在使用该数据集进行数据驱动的模型开发(如机器学习分类器)之前解决。一些数据预处理算法应用于原始数据,以解决常见的问题,如消除冗余的功能,转换为数字格式的名义特征和缩放。PCA,t-SNE和K-均值聚类算法用于开发可视化的图形和绘图。通过可视化的对比分析,确定并说明了该数据集的两个主要问题,即类不平衡和类重叠。总之,在将此数据集用于任何分类器模型开发之前,有必要解决类不平衡和类重叠这两个问题。

英文摘要:

This paper presents a visual analysis of the UNSW-NB25 computer network security or intrusion detection dataset in order to detect any issues inherent to this dataset which may require researchers to address before employing this dataset for data-driven model development such as a machine learning classifier. A number of data preprocessing algorithms are applied on the raw data to address common issues such as elimination of redundant features, conversion of nominal features into numerical format and scaling. PCA, t-SNE and K-means clustering algorithms are employed for developing the graphs and plots for visualization. Consequent analysis through visualization identified and illustrated two major problems as class imbalance and class overlap for this dataset. In conclusion, it is necessary to address these two problems of class imbalance and class overlap prior to employing this dataset for any classifier model development.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑