arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1706.09357cs.SE
收藏

变分分析的差异检验:开发KConfigReader的经验

Differential Testing for Variational Analyses: Experience from Developing KConfigReader

Christian Kästner

摘要:

差分测试解决了预言机问题,已经应用在许多场景中,其中存在多个假定等效的实现,例如C编译器的多个实现。如果多个系统在给定测试输入的输出上不一致,那么我们可能已经发现了一个bug,而不必指定预期的输出是什么。对变分分析(或变分感知或基于族的分析)的研究可以从类似的想法中受益。大多数变分分析的目标是对大量配置执行分析,例如类型检查或模型检验,比现有的传统分析通过单独分析每个配置来执行的速度快得多。变分分析非常适合于差分测试,因为存在非变分分析可以为测试用例提供预言,否则将是乏味或难以编写的。在这篇经验论文中,我报告了差分测试如何帮助开发KConfigReader,一个将Linux内核的kconfig模型转换为命题公式的工具。差分测试使我们能够快速构建一个大型测试库,并整合外部测试,从而避免了开发过程中的许多回归,并使KConfigReader成为最精确的kconfig提取工具。

英文摘要:

Differential testing to solve the oracle problem has been applied in many scenarios where multiple supposedly equivalent implementations exist, such as multiple implementations of a C compiler. If the multiple systems disagree on the output for a given test input, we have likely discovered a bug without every having to specify what the expected output is. Research on variational analyses (or variability-aware or family-based analyses) can benefit from similar ideas. The goal of most variational analyses is to perform an analysis, such as type checking or model checking, over a large number of configurations much faster than an existing traditional analysis could by analyzing each configuration separately. Variational analyses are very suitable for differential testing, since the existence nonvariational analysis can provide the oracle for test cases that would otherwise be tedious or difficult to write. In this experience paper, I report how differential testing has helped in developing KConfigReader, a tool for translating the Linux kernel's kconfig model into a propositional formula. Differential testing allows us to quickly build a large test base and incorporate external tests that avoided many regressions during development and made KConfigReader likely the most precise kconfig extraction tool available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑