软误差对二值化神经网络推理影响的熵建模
Entropy-Based Modeling for Estimating Soft Errors Impact on Binarized Neural Network Inference
摘要:
在过去的几年里,大规模数据集的易访问性显著改变了开发由神经网络(NN)驱动的高精度预测模型的范式。这些模型可能会受到辐射引起的瞬态故障的影响,这可能会导致长期运行的预期NN推理加速器逐渐降级。我们对NN推理加速器进行严格的脆弱性评估的关键观察结果表明,权重和激活函数对单事件翻转(SEU)和多位翻转(MBU)的敏感性不均匀,特别是在我们选择的卷积神经网络的前五层中。在本文中,我们提出了相对准确的统计模型,以描绘所进行的SEU和MBU跨层和每一层的选定NN的影响。这些模型可用于评估错误的弹性大小的NN拓扑结构,然后才采用它们在安全关键的应用。
英文摘要:
Over past years, the easy accessibility to the large scale datasets has significantly shifted the paradigm for developing highly accurate prediction models that are driven from Neural Network (NN). These models can be potentially impacted by the radiation-induced transient faults that might lead to the gradual downgrade of the long-running expected NN inference accelerator. The crucial observation from our rigorous vulnerability assessment on the NN inference accelerator demonstrates that the weights and activation functions are unevenly susceptible to both single-event upset (SEU) and multi-bit upset (MBU), especially in the first five layers of our selected convolution neural network. In this paper, we present the relatively-accurate statistical models to delineate the impact of both undertaken SEU and MBU across layers and per each layer of the selected NN. These models can be used for evaluating the error-resiliency magnitude of NN topology before adopting them in the safety-critical applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。