当单粒子扰动遇到深层神经网络:观察、探索和补救
When Single Event Upset Meets Deep Neural Networks: Observations, Explorations, and Remedies
摘要:
深度神经网络已经证明了它在各种感知任务中的潜力,因此成为安全敏感系统中解释和数据处理的一个有吸引力的选择。然而,安全敏感系统不仅需要高的感知性能,而且在各种情况下设计鲁棒性。与以往从软件层面研究网络鲁棒性的工作不同,本文从硬件角度研究了单粒子翻转(SEU)引起的参数扰动(SIPP)对神经网络的影响.系统地定义了单粒子翻转的故障模型,并给出了对SIPP敏感度的定义,作为网络鲁棒性的度量。然后,我们能够分析探索网络的弱点,并总结SIPP对浮点参数中不同类型位的影响,同一网络中的逐层鲁棒性以及网络深度的影响的关键发现。基于这些发现,我们提出了两种补救解决方案来保护DNN免受SIP的影响,这可以将ResNet的准确性降低28%至0.27%,每个参数仅需0.24位SRAM面积开销。
英文摘要:
Deep Neural Network has proved its potential in various perception tasks and hence become an appealing option for interpretation and data processing in security sensitive systems. However, security-sensitive systems demand not only high perception performance, but also design robustness under various circumstances. Unlike prior works that study network robustness from software level, we investigate from hardware perspective about the impact of Single Event Upset (SEU) induced parameter perturbation (SIPP) on neural networks. We systematically define the fault models of SEU and then provide the definition of sensitivity to SIPP as the robustness measure for the network. We are then able to analytically explore the weakness of a network and summarize the key findings for the impact of SIPP on different types of bits in a floating point parameter, layer-wise robustness within the same network and impact of network depth. Based on those findings, we propose two remedy solutions to protect DNNs from SIPPs, which can mitigate accuracy degradation from 28% to 0.27% for ResNet with merely 0.24-bit SRAM area overhead per parameter.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。