arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.06012cs.CRcs.LG
收藏

WebEye -恶意HTTP流量的自动收集

WebEye - Automated Collection of Malicious HTTP Traffic

Fraunhofer Institute AISEC(弗劳恩霍夫应用安全研究所以色列分所)

Johann Vierthaler, Roman Kruszelnicki, Julian Schütte

摘要:

随着恶意软件检测技术越来越多地采用机器学习方法,创建精确的训练集变得越来越重要。需要真实网络流量的大数据集,正确分类为良性或恶意,不仅要训练经典和深度学习算法,还要作为现有恶意软件检测产品的评估基准。有趣的是,尽管用户在浏览web时可能遇到大量和多功能的威胁,但是实际的恶意内容通常很难得到,因为必须满足诸如浏览器和操作系统类型和版本之类的先决条件,以便从恶意软件分发服务器接收有效载荷。结合对实际用户流量数据集的隐私限制,研究人员和产品开发人员很难针对实际Web流量的大规模数据集评估反恶意软件解决方案。在本文中,我们提出了WebEye,一个框架,自主创建现实的HTTP流量,丰富记录的流量与额外的信息,并分类记录为恶意或良性的,使用不同的分类。我们正在使用WebEye收集恶意HTML和JavaScript,并展示如何使用WebEye创建的数据集来训练基于机器学习的恶意软件检测算法。我们将WebEye及其创建的数据集视为研究人员和产品开发人员的工具,以针对大规模基准评估和改进其基于AI的反恶意软件解决方案。

英文摘要:

With malware detection techniques increasingly adopting machine learning approaches, the creation of precise training sets becomes more and more important. Large data sets of realistic web traffic, correctly classified as benign or malicious are needed, not only to train classic and deep learning algorithms, but also to serve as evaluation benchmarks for existing malware detection products. Interestingly, despite the vast number and versatility of threats a user may encounter when browsing the web, actual malicious content is often hard to come by, since prerequisites such as browser and operating system type and version must be met in order to receive the payload from a malware distributing server. In combination with privacy constraints on data sets of actual user traffic, it is difficult for researchers and product developers to evaluate anti-malware solutions against large-scale data sets of realistic web traffic. In this paper we present WebEye, a framework that autonomously creates realistic HTTP traffic, enriches recorded traffic with additional information, and classifies records as malicious or benign, using different classifiers. We are using WebEye to collect malicious HTML and JavaScript and show how datasets created with WebEye can be used to train machine learning based malware detection algorithms. We regard WebEye and the data sets it creates as a tool for researchers and product developers to evaluate and improve their AI-based anti-malware solutions against large-scale benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑