arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.04472cs.SE
收藏

BinMLM:基于流感知混合共享语言模型的二进制作者身份验证

BinMLM: Binary Authorship Verification with Flow-aware Mixture-of-Shared Language Model

Qige Song, Yongzheng Zhang, Linshu Ouyang, Yige Chen

摘要:

二进制作者身份分析是许多软件工程应用中的重要问题。在本文中,我们制定了一个二进制的作者身份验证任务,以准确地反映真实世界的软件取证专家的工作过程。它旨在确定匿名二进制文件是否由特定程序员使用一小组支持样本开发,而实际开发人员可能不属于已知候选集,而是来自野外。我们提出了一个有效的二进制作者身份验证框架,BinMLM。BinMLM在从控制流图(CFG)提取的连续操作码跟踪上训练RNN语言模型,以表征候选开发人员的编程风格。我们构建了一个混合共享架构,其中包含多个共享编码器和作者特定的门层,可以学习开发人员对通用编程模式的组合偏好,并缓解训练资源不足的问题。通过外部预训练,联合训练和微调的优化管道,我们的框架可以消除额外的噪音并准确地提取开发人员的独特风格。大量的实验表明,BinMLM在不同数量的程序员和支持样本的Google Code Jam(GCJ)和Codeforces数据集上取得了令人满意的结果。它的性能显著优于基于最先进功能集构建的基线(4.73%到19.46%的改进),并且在多作者协作场景中保持稳健。此外,BinMLM可以对真实世界的APT恶意软件数据集执行组织级验证,这可以为探索APT攻击背后的组织提供有价值的辅助信息。

英文摘要:

Binary authorship analysis is a significant problem in many software engineering applications. In this paper, we formulate a binary authorship verification task to accurately reflect the real-world working process of software forensic experts. It aims to determine whether an anonymous binary is developed by a specific programmer with a small set of support samples, and the actual developer may not belong to the known candidate set but from the wild. We propose an effective binary authorship verification framework, BinMLM. BinMLM trains the RNN language model on consecutive opcode traces extracted from the control-flow-graph (CFG) to characterize the candidate developers' programming styles. We build a mixture-of-shared architecture with multiple shared encoders and author-specific gate layers, which can learn the developers' combination preferences of universal programming patterns and alleviate the problem of low training resources. Through an optimization pipeline of external pre-training, joint training, and fine-tuning, our framework can eliminate additional noise and accurately distill developers' unique styles. Extensive experiments show that BinMLM achieves promising results on Google Code Jam (GCJ) and Codeforces datasets with different numbers of programmers and supporting samples. It significantly outperforms the baselines built on the state-of-the-art feature set (4.73% to 19.46% improvement) and remains robust in multi-author collaboration scenarios. Furthermore, BinMLM can perform organization-level verification on a real-world APT malware dataset, which can provide valuable auxiliary information for exploring the group behind the APT attack.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑