arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.02601cs.SE
收藏

分布式系统的灰盒模糊测试

Greybox Fuzzing of Distributed Systems

Ruijie Meng, George Pîrlea, Abhik Roychoudhury, Ilya Sergey

AI总结:

本文提出首个分布式系统灰盒模糊测试框架 Mallory,通过 Lamport 时间线抽象和 Q-learning 自适应注入故障,相比 Jepsen 探索更多行为并更快发现缺陷,在 Braft、Dqlite 和 Redis 等系统中发现 22 个零日缺陷。

摘要:

灰盒模糊测试是在顺序程序中查找缺陷的轻量级首选方法。它通过使用从观测到的测试执行中获得的反馈函数,在程序输入域上进行有偏随机搜索,从而在效率和有效性之间取得平衡。然而,对于分布式系统测试而言,当前的技术水平仍然仅由黑盒工具代表,这些工具不尝试推断和利用系统过去行为的任何知识来指导缺陷搜索。\n在这项工作中,我们提出了 Mallory:第一个用于分布式系统灰盒模糊测试的框架。与流行的黑盒分布式系统模糊测试工具(如 Jepsen)不同,后者通过随机注入网络分区和节点故障或遵循人工定义的调度来搜索缺陷,Mallory 具有自适应性。它运用一种新颖的度量来学习如何通过选择不同的故障序列来最大化观测到的系统行为数量,从而增加发现新缺陷的可能性。我们的方法依赖于时间线驱动的测试。Mallory 动态构建系统行为的 Lamport 时间线,并进一步将这些时间线抽象为 happens-before 摘要,这些摘要作为指导模糊测试活动的反馈函数。随后,Mallory 使用 Q-learning 反应式地学习策略,使其能够根据对摘要的实时观测来引入故障。\n我们在一组广泛使用的多样化工业分布式系统上评估了 Mallory。与最先进的黑盒模糊测试工具 Jepsen 相比,Mallory 探索了更多的行为,并且发现缺陷所需的时间更短。Mallory 在 Braft、Dqlite 和 Redis 等经过严格测试的分布式系统中发现了 22 个零日缺陷(其中 18 个已由开发者确认),包括 10 个新漏洞。已分配了 6 个新的 CVE。

英文摘要:

Grey-box fuzzing is the lightweight approach of choice for finding bugs in sequential programs. It provides a balance between efficiency and effectiveness by conducting a biased random search over the domain of program inputs using a feedback function from observed test executions. For distributed system testing, however, the state-of-practice is represented today by only black-box tools that do not attempt to infer and exploit any knowledge of the system's past behaviours to guide the search for bugs. In this work, we present Mallory: the first framework for grey-box fuzz-testing of distributed systems. Unlike popular black-box distributed system fuzzers, such as Jepsen, that search for bugs by randomly injecting network partitions and node faults or by following human-defined schedules, Mallory is adaptive. It exercises a novel metric to learn how to maximize the number of observed system behaviors by choosing different sequences of faults, thus increasing the likelihood of finding new bugs. Our approach relies on timeline-driven testing. Mallory dynamically constructs Lamport timelines of the system behaviour and further abstracts these timelines into happens-before summaries, which serve as a feedback function guiding the fuzz campaign. Subsequently, Mallory reactively learns a policy using Q-learning, enabling it to introduce faults guided by its real-time observation of the summaries. We have evaluated Mallory on a diverse set of widely-used industrial distributed systems. Compared to the start-of-the-art black-box fuzzer Jepsen, Mallory explores more behaviours and takes less time to find bugs. Mallory discovered 22 zero-day bugs (of which 18 were confirmed by developers), including 10 new vulnerabilities, in rigorously-tested distributed systems such as Braft, Dqlite, and Redis. 6 new CVEs have been assigned.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑