arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.08515cs.SE
收藏

为更优的JVM模糊测试选择初始种子

Selecting Initial Seeds for Better JVM Fuzzing

Tianchang Gao, Junjie Chen, Dong Wang, Yile Guo, Yingquan Zhao, Zan Wang

AI总结:

针对现有种子选择方法是否适配JVM模糊测试的疑问,设计三类共10种种子选择方法,经多JVM、多模糊测试技术的实证验证,基于控制流图的程序特征法性能最优,可提升漏洞检测效率与效果。

摘要:

传统程序模糊测试领域的文献已证实,测试效果很大程度上受初始种子间冗余性的影响,因此学界提出了一系列种子选择方法。与传统模糊测试相比,JVM模糊测试具备独特特征,包括代码规模庞大且结构复杂,以及测试程序同时兼具语法和语义属性。然而,现有种子选择方法是否适用于JVM模糊测试,以及利用程序特征能否提升测试效果,目前尚不明确。\n为解决这一问题,我们共设计了10种初始种子选择方法,涵盖基于覆盖率的方法、基于预模糊测试的方法以及基于程序特征的方法。随后我们针对3款JVM实现开展实证研究,在两种前沿(SOTA)模糊测试技术(JavaTailor和VECT)中广泛评估这些种子选择方法的性能。我们具体从三个维度考察性能:(i)采用广泛研究的初始种子时的效果与效率,(ii)采用真实环境程序时的效果,(iii)检测新漏洞的能力。\n评估结果首先显示,利用控制流图的基于程序特征的方法不仅时间开销显著更低(仅30秒),性能还优于其他方法,与初始种子全集相比提升幅度达142%至269%。其次,结果表明初始种子选择大幅提升了真实环境程序的质量,且能检测到新的行为,展现出效果上的互补性。第三,结果证实在相同测试周期内,初始种子选择能提升JVM模糊测试技术的表现,检测到更多未知漏洞。具体而言,检测到的25个漏洞中有21个已得到开发者确认或修复。本工作首次研究了JVM模糊测试中的初始种子选择问题,证实了其对模糊测试效果与效率的重要性。

英文摘要:

Literature in traditional program fuzzing has confirmed that effectiveness is largely impacted by redundancy among initial seeds, thereby proposing a series of seed selection methods. JVM fuzzing, compared to traditional ones, presents unique characteristics, including large-scale and intricate code, and programs with both syntactic and semantic features. However, it remains unclear whether the existing seed selection methods are suitable for JVM fuzzing and whether utilizing program features can enhance effectiveness. To address this, we devise a total of 10 initial seed selection methods, comprising coverage-based, prefuzz-based, and program-feature-based methods. We then conduct an empirical study on three JVM implementations to extensively evaluate the performance of the seed selection methods within two SOTA fuzzing techniques (JavaTailor and VECT). Specifically, we examine performance from three aspects: (i) effectiveness and efficiency using widely studied initial seeds, (ii) effectiveness using the programs in the wild, and (iii) the ability to detect new bugs. Evaluation results first show that the program-feature-based method that utilizes the control flow graph not only has a significantly lower time overhead (i.e., 30s), but also outperforms other methods, achieving 142% to 269% improvement compared to the full set of initial seeds. Second, results reveal that the initial seed selection greatly improves the quality of wild programs and exhibits complementary effectiveness by detecting new behaviors. Third, results demonstrate that given the same testing period, initial seed selection improves the JVM fuzzing techniques by detecting more unknown bugs. Particularly, 21 out of the 25 detected bugs have been confirmed or fixed by developers. This work takes the first look at initial seed selection in JVM fuzzing, confirming its importance in fuzzing effectiveness and efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑