arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1808.09413cs.SE
收藏

DLFuzz:深度学习系统的差分模糊测试

DLFuzz: Differential Fuzzing Testing of Deep Learning Systems

Jianmin Guo, Yu Jiang, Yue Zhao, Quan Chen, Jiaguang Sun

摘要:

深度学习(DL)系统越来越多地应用于安全关键领域,如自动驾驶汽车。保证DL系统的可靠性和鲁棒性具有重要意义。现有的神经元测试方法往往无法包含测试数据集中的稀有输入,并且神经元覆盖率较低。在本文中,我们提出了DLFuzz,第一个差分模糊测试框架,以指导DL系统暴露不正确的行为。DLFuzz不断对输入进行细微的变异,以最大化神经元覆盖率以及原始输入和变异输入之间的预测差异,而无需手动标记工作或交叉引用具有相同功能的其他DL系统的预言机。我们提出了两个著名的数据集的实证评估,以证明其效率。与最先进的深度学习白盒测试框架DeepXplore相比,DLFuzz不需要额外的努力来寻找类似的功能性深度学习系统进行交叉引用检查,但可以生成多338.59%的对抗性输入,同时具有89.82%的小扰动,平均获得高2.86%的神经元覆盖率,节省20.11%的时间消耗。

英文摘要:

Deep learning (DL) systems are increasingly applied to safety-critical domains such as autonomous driving cars. It is of significant importance to ensure the reliability and robustness of DL systems. Existing testing methodologies always fail to include rare inputs in the testing dataset and exhibit low neuron coverage. In this paper, we propose DLFuzz, the frst differential fuzzing testing framework to guide DL systems exposing incorrect behaviors. DLFuzz keeps minutely mutating the input to maximize the neuron coverage and the prediction difference between the original input and the mutated input, without manual labeling effort or cross-referencing oracles from other DL systems with the same functionality. We present empirical evaluations on two well-known datasets to demonstrate its efficiency. Compared with DeepXplore, the state-of-the-art DL whitebox testing framework, DLFuzz does not require extra efforts to find similar functional DL systems for cross-referencing check, but could generate 338.59% more adversarial inputs with 89.82% smaller perturbations, averagely obtain 2.86% higher neuron coverage, and save 20.11% time consumption.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑