EMBERSim: 一个用于推进恶意软件分析中相似性搜索的大规模数据库
EMBERSim: A Large-Scale Databank for Boosting Similarity Search in Malware Analysis
AI总结:
针对恶意软件相似性研究数据稀缺且多忽略良性数据的问题,研究团队基于大规模恶意软件分类数据集EMBER构建了增强版数据库EMBERSim,补充相似性标签与自动标注的恶意软件类别标签,并开源相关方法实现。
摘要:
近年来,恶意软件检测已从基于启发式的方法转向机器学习,在当前对抗性极强的威胁环境中,机器学习被证明更具鲁棒性。我们承认机器学习更擅长挖掘数量日益增长、外观相似的文件中的模式,但也注意到面向相似性研究的可用数据极为稀缺。此外,我们观察到少数相关研究的重点在于量化恶意软件的相似性,却常常忽略了干净(良性)数据。在检测绕过的场景下,这种片面的量化尤其危险。我们提出从EMBER——最大规模的恶意软件分类数据集之一——入手,解决二进制文件相似性研究领域的不足。我们为EMBER添加了相似性信息以及恶意软件类别标签,以支持相似性领域的进一步研究。我们的贡献分为三方面:(1)我们发布了EMBERSim,这是EMBER的增强版本,包含带相似性信息的标签;(2)我们利用VirusTotal数据上的开源工具AVClass,通过自动确定的恶意软件类别标签丰富了EMBERSim;(3)我们描述并分享了我们的类别评分技术和叶子节点相似性方法的实现。
英文摘要:
In recent years there has been a shift from heuristics-based malware detection towards machine learning, which proves to be more robust in the current heavily adversarial threat landscape. While we acknowledge machine learning to be better equipped to mine for patterns in the increasingly high amounts of similar-looking files, we also note a remarkable scarcity of the data available for similarity-targeted research. Moreover, we observe that the focus in the few related works falls on quantifying similarity in malware, often overlooking the clean data. This one-sided quantification is especially dangerous in the context of detection bypass. We propose to address the deficiencies in the space of similarity research on binary files, starting from EMBER - one of the largest malware classification data sets. We enhance EMBER with similarity information as well as malware class tags, to enable further research in the similarity space. Our contribution is threefold: (1) we publish EMBERSim, an augmented version of EMBER, that includes similarity-informed tags; (2) we enrich EMBERSim with automatically determined malware class tags using the open-source tool AVClass on VirusTotal data and (3) we describe and share the implementation for our class scoring technique and leaf similarity method.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。