arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.14987cs.SEcs.CR
收藏

基于逻辑状态覆盖的无目标模糊测试比较质量度量

A Comparative Quality Metric for Untargeted Fuzzing with Logic State Coverage

Gwangmu Lee

AI总结:

针对现有模糊测试质量度量标准不可靠的问题,提出逻辑状态覆盖作为代理度量,通过统计执行中满足的分支集合来更细粒度地计算观察到的有趣行为,并在AFL++和XMLLint上进行了初步评估验证其可靠性。

摘要:

虽然模糊测试被广泛接受为一种高效的程序测试技术,但目前仍不清楚如何衡量不同模糊测试器的比较质量。当前事实上的质量度量标准是边覆盖和发现的漏洞数量,但它们经常因结果不明确、夸大甚至违背直觉而受到质疑。为了建立更可靠的质量度量标准,我们首先注意到模糊测试旨在通过观察更多有趣(即与未知异常相关)的行为来减少未知异常行为的数量。模糊测试器观察到的有趣行为越多,它就能为不存在未知异常行为提供更强的保证。这表明观察到的有趣行为的数量必须直接指示模糊测试的质量。在这项工作中,我们提出逻辑状态覆盖作为代理度量来计算观察到的有趣行为。逻辑状态是一次执行期间一组满足的分支,其覆盖是模糊测试活动期间观察到的单个逻辑状态的计数。逻辑状态以更细的粒度区分较少重复(即更有趣)的行为,使逻辑状态覆盖量可靠地与观察到的有趣行为数量成正比。我们使用布隆过滤器实现了逻辑状态覆盖,并使用AFL++和XMLLint进行了初步评估。

英文摘要:

While fuzzing is widely accepted as an efficient program testing technique, it is still unclear how to measure the comparative quality of different fuzzers. The current de facto quality metrics are edge coverage and the number of discovered bugs, but they are frequently discredited by inconclusive, exaggerated, or even counter-intuitive results. To establish a more reliable quality metric, we first note that fuzzing aims to reduce the number of unknown abnormal behaviors by observing more interesting (i.e., relating to unknown abnormal) behaviors. The more interesting behaviors a fuzzer has observed, the stronger guarantee it can provide about the absence of unknown abnormal behaviors. This suggests that the number of observed interesting behaviors must directly indicate the fuzzing quality. In this work, we propose logic state coverage as a proxy metric to count observed interesting behaviors. A logic state is a set of satisfied branches during one execution, where its coverage is the count of individual observed logic states during a fuzzing campaign. A logic state distinguishes less repetitive (i.e., more interesting) behaviors in a finer granularity, making the amount of logic state coverage reliably proportional to the number of observed interesting behaviors. We implemented logic state coverage using a bloom filter and performed a preliminary evaluation with AFL++ and XMLLint.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑