arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.00922cs.CR
收藏

ProphetFuzz:仅凭文档通过大语言模型全自动预测与模糊测试高风险选项组合

ProphetFuzz: Fully Automated Prediction and Fuzzing of High-Risk Option Combinations with Only Documentation via Large Language Model

Dawei Wang, Geng Zhou, Li Chen, Dan Li, Yukai Miao

AI总结:

ProphetFuzz利用大语言模型仅凭文档自动预测高风险选项组合并进行模糊测试,在52个程序上以极低成本发现大量漏洞,显著优于现有方法。

摘要:

与选项组合相关的漏洞由于搜索空间巨大,在软件安全测试中构成重大挑战。以往研究主要通过变异或过滤技术应对这一挑战,但这些方法低效地将所有选项组合视为具有相同的漏洞潜力,从而在非脆弱目标上浪费大量时间,导致测试效率低下。本文利用精心设计的提示工程驱动大语言模型(LLM)预测高风险选项组合(即更可能包含漏洞的组合),并在无需人工干预的情况下自动执行模糊测试。我们开发了一款名为ProphetFuzz的工具,并在一个包含52个程序的数据集上对其进行了评估,该数据集收集自三项相关研究。整个实验消耗了10.44个CPU年。ProphetFuzz成功预测了1748个高风险选项组合,每个程序的平均成本仅为8.69美元。结果表明,经过72小时的模糊测试,ProphetFuzz发现了364个独立漏洞,涉及12.30%的预测高风险选项组合,比同一时间段内最先进方法发现的漏洞高出32.85%。此外,利用ProphetFuzz,我们对这些程序的最新版本进行了持续模糊测试,发现了140个漏洞,其中93个已得到开发者确认,21个获得了CVE编号。

英文摘要:

Vulnerabilities related to option combinations pose a significant challenge in software security testing due to their vast search space. Previous research primarily addressed this challenge through mutation or filtering techniques, which inefficiently treated all option combinations as having equal potential for vulnerabilities, thus wasting considerable time on non-vulnerable targets and resulting in low testing efficiency. In this paper, we utilize carefully designed prompt engineering to drive the large language model (LLM) to predict high-risk option combinations (i.e., more likely to contain vulnerabilities) and perform fuzz testing automatically without human intervention. We developed a tool called ProphetFuzz and evaluated it on a dataset comprising 52 programs collected from three related studies. The entire experiment consumed 10.44 CPU years. ProphetFuzz successfully predicted 1748 high-risk option combinations at an average cost of only \$8.69 per program. Results show that after 72 hours of fuzzing, ProphetFuzz discovered 364 unique vulnerabilities associated with 12.30\% of the predicted high-risk option combinations, which was 32.85\% higher than that found by state-of-the-art in the same timeframe. Additionally, using ProphetFuzz, we conducted persistent fuzzing on the latest versions of these programs, uncovering 140 vulnerabilities, with 93 confirmed by developers and 21 awarded CVE numbers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑