arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2107.11445cs.LGcs.NE
收藏

用于安全分类的自校正神经网络

Self-Correcting Neural Networks For Safe Classification

Carnegie Mellon University(卡内基梅隆大学);INRIA Paris(法国国家信息与自动化研究所巴黎分部)

Klas Leino, Aymeric Fromherz, Ravi Mangal, Matt Fredrikson, Bryan Parno, Corina Păsăreanu

摘要:

从数据中学习的分类器越来越多地被用作安全性至关重要的系统中的组件。在这项工作中,我们提出了一个正式的概念,通过安全排序约束的约束分类器的安全。这些约束关系的要求,分类器输出的类的顺序,其输入条件,并有足够的表现力来编码各种有趣的例子,从文献分类器的安全规范。对于使用神经网络实现的分类器,我们还提出了一个运行时的安全排序约束的执行机制。我们的方法是基于一个自校正层,可证明产生安全的输出,而不管分类器输入的特性。我们将这一层与现有的神经网络分类器组成一个自校正网络(SC-Net),并表明除了提供安全的输出外,SC-Net还保证尽可能保持原始网络的分类精度。我们的方法是独立的用于分类的神经网络的大小和架构,仅取决于指定的属性和网络的输出的维度,因此它是可扩展的大型国家的最先进的网络。我们表明,我们的方法可以针对GPU进行优化,在当前硬件上引入不到1 ms的运行时开销-即使在包含数十万个神经元和数百万个参数的大型广泛使用的网络上也是如此。

英文摘要:

Classifiers learnt from data are increasingly being used as components in systems where safety is a critical concern. In this work, we present a formal notion of safety for classifiers via constraints called safe-ordering constraints. These constraints relate requirements on the order of the classes output by a classifier to conditions on its input, and are expressive enough to encode various interesting examples of classifier safety specifications from the literature. For classifiers implemented using neural networks, we also present a run-time mechanism for the enforcement of safe-ordering constraints. Our approach is based on a self-correcting layer, which provably yields safe outputs regardless of the characteristics of the classifier input. We compose this layer with an existing neural network classifier to construct a self-correcting network (SC-Net), and show that in addition to providing safe outputs, the SC-Net is guaranteed to preserve the classification accuracy of the original network whenever possible. Our approach is independent of the size and architecture of the neural network used for classification, depending only on the specified property and the dimension of the network's output; thus it is scalable to large state-of-the-art networks. We show that our approach can be optimized for a GPU, introducing run-time overhead of less than 1ms on current hardware -- even on large, widely-used networks containing hundreds of thousands of neurons and millions of parameters.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑