arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2309.02206cs.LGcs.OScs.SE
收藏

系统调用轨迹中的新颖性检测语言模型

Language Models for Novelty Detection in System Call Traces

Polytechnique Montreal(蒙特利尔理工学院)

Quentin Fournier, Daniel Aloise, Leandro R. Costa

AI总结:

本文提出一种基于系统调用序列语言模型的新颖性检测方法,评估LSTM、Transformer和Longformer三种架构,并发布包含超200万Web请求的开源内核轨迹数据集,在多数新颖性上F分数和AuROC超过95%。

摘要:

由于现代计算机系统的复杂性,新颖和意外的行为频繁发生。这些偏差要么是正常情况,如软件更新和新的用户活动,要么是异常情况,如配置错误、延迟问题、入侵和软件缺陷。无论如何,新颖行为对开发人员来说都极具吸引力,并且确实需要高效且有效的方法来检测它们。如今,研究人员认为系统调用是调查计算机系统行为的最细粒度且最准确的信息来源。因此,本文介绍了一种新颖性检测方法,该方法依赖于系统调用序列上的概率分布,可视为一种语言模型。语言模型估计序列的可能性,由于新颖性按定义偏离了先前观察到的行为,因此它们在模型下将是不太可能的。继神经网络在语言模型中的成功之后,本文评估了三种架构:广泛使用的LSTM、最先进的Transformer和较低复杂度的Longformer。然而,大型神经网络通常需要大量数据才能有效训练,并且据我们所知,目前没有公开的大规模现代内核轨迹数据集。本文通过引入一个新的开源内核轨迹数据集来解决这一限制,该数据集包含超过200万个具有七种不同行为的Web请求。所提出的方法需要最少的专家手工设计,并且在大多数新颖性上实现了大于95%的F分数和AuROC,同时具有数据无关性和任务无关性。源代码和训练模型在GitHub上公开,而数据集可在Zenodo上获取。

英文摘要:

Due to the complexity of modern computer systems, novel and unexpected behaviors frequently occur. Such deviations are either normal occurrences, such as software updates and new user activities, or abnormalities, such as misconfigurations, latency issues, intrusions, and software bugs. Regardless, novel behaviors are of great interest to developers, and there is a genuine need for efficient and effective methods to detect them. Nowadays, researchers consider system calls to be the most fine-grained and accurate source of information to investigate the behavior of computer systems. Accordingly, this paper introduces a novelty detection methodology that relies on a probability distribution over sequences of system calls, which can be seen as a language model. Language models estimate the likelihood of sequences, and since novelties deviate from previously observed behaviors by definition, they would be unlikely under the model. Following the success of neural networks for language models, three architectures are evaluated in this work: the widespread LSTM, the state-of-the-art Transformer, and the lower-complexity Longformer. However, large neural networks typically require an enormous amount of data to be trained effectively, and to the best of our knowledge, no massive modern datasets of kernel traces are publicly available. This paper addresses this limitation by introducing a new open-source dataset of kernel traces comprising over 2 million web requests with seven distinct behaviors. The proposed methodology requires minimal expert hand-crafting and achieves an F-score and AuROC greater than 95% on most novelties while being data- and task-agnostic. The source code and trained models are publicly available on GitHub while the datasets are available on Zenodo.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑