arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1910.06192cs.CRcs.LG
收藏

对“AndrODet:一个自适应的Android混淆检测器”的评论

Comment on "AndrODet: An adaptive Android obfuscation detector"

Linköping University(林雪平大学)

Alireza Mohammadinodooshan, Ulf Kargén, Nahid Shahmehri

摘要:

我们已经确定了Mirzaei等人在最近的论文“AndrODet:An adaptive Android obfuscation detector”中描述的AndrODet系统的字符串加密检测能力的经验评估中的方法问题。使用AMD和PraGuard恶意软件数据集的样本评估字符串加密检测的准确性。然而,作者没有考虑到许多AMD样本高度相似的事实,因为它们来自同一个恶意软件家族。这引入了在这些样本上训练的机器学习系统可能无法学习用于字符串加密检测的可推广模型的风险,并且可能改为学习基于每个恶意软件家族的特征对样本进行分类。我们自己的评估强烈表明,AndrODet的字符串加密检测的高准确性确实是由于这种现象。当我们评估AndrODet时,我们发现当我们确保来自同一家族的样本从未出现在训练和测试数据中时,准确率下降到50%左右。此外,PraGuard数据集不适合评估静态字符串加密检测器(如AndrODet),因为用于有效生成数据集的特定混淆工具使其无法提取Android应用程序中静态字符串的有意义特征。

英文摘要:

We have identified a methodological problem in the empirical evaluation of the string encryption detection capabilities of the AndrODet system described by Mirzaei et al. in the recent paper "AndrODet: An adaptive Android obfuscation detector". The accuracy of string encryption detection is evaluated using samples from the AMD and PraGuard malware datasets. However, the authors failed to account for the fact that many of the AMD samples are highly similar due to the fact that they come from the same malware family. This introduces a risk that a machine learning system trained on these samples could fail to learn a generalizable model for string encryption detection, and might instead learn to classify samples based on characteristics of each malware family. Our own evaluation strongly indicates that the reported high accuracy of AndrODet's string encryption detection is indeed due to this phenomenon. When we evaluated AndrODet, we found that when we ensured that samples from the same family never appeared in both training and testing data, the accuracy dropped to around 50%. Moreover, the PraGuard dataset is not suitable for evaluating a static string encryption detector such as AndrODet, since the particular obfuscation tool used to produce the dataset effectively makes it impossible to extract meaningful features of static strings in Android apps.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑