arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2205.08944cs.CRcs.LG
收藏

SoK:未标记数据在网络威胁检测中的影响

SoK: The Impact of Unlabelled Data in Cyberthreat Detection

Institute of Information Systems – University of Liechtenstein(列支敦士登大学信息系统研究所)

Giovanni Apruzzese, Pavel Laskov, Aliya Tastemirova

摘要:

近年来,机器学习(ML)已成为网络威胁检测(CTD)的重要范式。大量的研究工作已经投入到CTD任务的专门算法的开发中。然而,从操作的角度来看,基于ML的CTD的进展受到难以获得大量标记数据集以训练ML检测器的阻碍。这个问题的一个潜在解决方案是半监督学习(SsL)方法,它将小的标记数据集与大量的未标记数据相结合。本文件旨在系统化现有的工作,对SSL的CTD,特别是了解在这种系统中的无标签的数据的效用。为此,我们分析了标签在各种CTD任务的成本,并在此背景下开发了一个正式的成本模型SSL。在此基础上,我们正式制定了一套要求评估的SSL方法,阐明了未标记的数据的贡献。我们回顾了最先进的技术,并观察到以前的工作都不符合这些要求。为了解决这个问题,我们提出了一个框架,用于评估SSL中未标记数据的好处。我们通过执行第一个基准评估来展示这个框架的应用,该评估突出了9个公共数据集上9个现有SSL方法的权衡。我们的研究结果证实,在某些情况下,未标记的数据提供了一个小的,但统计上显着的性能增益。本文强调了CTD中的SSL有很大的改进空间,这应该激发这一领域的未来研究。

英文摘要:

Machine learning (ML) has become an important paradigm for cyberthreat detection (CTD) in the recent years. A substantial research effort has been invested in the development of specialized algorithms for CTD tasks. From the operational perspective, however, the progress of ML-based CTD is hindered by the difficulty in obtaining the large sets of labelled data to train ML detectors. A potential solution to this problem are semisupervised learning (SsL) methods, which combine small labelled datasets with large amounts of unlabelled data. This paper is aimed at systematization of existing work on SsL for CTD and, in particular, on understanding the utility of unlabelled data in such systems. To this end, we analyze the cost of labelling in various CTD tasks and develop a formal cost model for SsL in this context. Building on this foundation, we formalize a set of requirements for evaluation of SsL methods, which elucidates the contribution of unlabelled data. We review the state-of-the-art and observe that no previous work meets such requirements. To address this problem, we propose a framework for assessing the benefits of unlabelled data in SsL. We showcase an application of this framework by performing the first benchmark evaluation that highlights the tradeoffs of 9 existing SsL methods on 9 public datasets. Our findings verify that, in some cases, unlabelled data provides a small, but statistically significant, performance gain. This paper highlights that SsL in CTD has a lot of room for improvement, which should stimulate future research in this field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑