arXivDaily arXiv每日学术速递 周一至周五更新
看起来今天可以划水了
arXiv 2103.17059cs.CRcs.LG
收藏

压缩和加密数据的可靠检测

Reliable Detection of Compressed and Encrypted Data

Sapienza Università di Roma(罗马大学);Worcester Polytechnic Institute(伍斯特理工学院)

Fabio De Gaspari, Dorjan Hitaj, Giulio Pagnotta, Lorenzo De Carli, Luigi V. Mancini

摘要:

一些网络安全领域,如勒索软件检测、取证和数据分析,需要可靠地识别加密数据片段的方法。通常,当前方法采用从字节级分布导出的统计数据(诸如熵估计)来识别加密片段。然而,现代内容类型使用压缩技术,这些技术改变了数据分布,使其更接近均匀分布。其结果是,当前的方法表现出不可靠的加密检测性能时,压缩数据出现在数据集中。此外,所提出的方法通常在几个数据类型和片段大小上进行评估,使得难以评估其实际适用性。本文比较了现有的大型标准化数据集的统计测试,并表明,目前的方法始终无法区分加密和压缩数据的大小和大小的片段大小。我们解决这些缺点,并设计EnCoD,一个基于学习的分类器,可以可靠地区分压缩和加密的数据。我们在16种不同文件类型和片段大小从512 B到8 KB的数据集上评估EnCoD。我们的研究结果强调,EnCoD优于目前的方法,在很大程度上,准确度范围从512 B片段的~82到8 KB数据片段的~92。此外,EnCoD可以精确定位给定数据片段的确切格式,而不是像以前的方法那样只执行二进制分类。

英文摘要:

Several cybersecurity domains, such as ransomware detection, forensics and data analysis, require methods to reliably identify encrypted data fragments. Typically, current approaches employ statistics derived from byte-level distribution, such as entropy estimation, to identify encrypted fragments. However, modern content types use compression techniques which alter data distribution pushing it closer to the uniform distribution. The result is that current approaches exhibit unreliable encryption detection performance when compressed data appears in the dataset. Furthermore, proposed approaches are typically evaluated over few data types and fragment sizes, making it hard to assess their practical applicability. This paper compares existing statistical tests on a large, standardized dataset and shows that current approaches consistently fail to distinguish encrypted and compressed data on both small and large fragment sizes. We address these shortcomings and design EnCoD, a learning-based classifier which can reliably distinguish compressed and encrypted data. We evaluate EnCoD on a dataset of 16 different file types and fragment sizes ranging from 512B to 8KB. Our results highlight that EnCoD outperforms current approaches by a wide margin, with accuracy ranging from ~82 for 512B fragments up to ~92 for 8KB data fragments. Moreover, EnCoD can pinpoint the exact format of a given data fragment, rather than performing only binary classification like previous approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑