arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1804.11313cs.NEmath.DSstat.ML
收藏

深度神经网络有多强大?

How Robust are Deep Neural Networks?

Biswa Sengupta, Karl J. Friston

摘要:

卷积和递归的深度神经网络在计算机视觉、强化学习和其他相关领域的机器学习系统中已经取得了成功。然而,这种神经网络的鲁棒性很少得到评价,特别是在获得高分类精度之后。在本文中,我们评估了三个经常性的神经网络对微小扰动的鲁棒性,在三个广泛使用的数据集上,认为高精度并不总是意味着稳定和鲁棒(有界扰动,对抗攻击等)。系统特别地,对离散递归网络的谱进行归一化,使其谱有界(使用幂法、Rayleigh商等)。产生稳定的,尽管高度非鲁棒的神经网络。此外,使用$ε$ -伪谱,我们表明,训练的递归网络,说使用基于梯度的方法,往往会导致非正规矩阵,可能会或可能不会对角化。因此,开放的问题在于构建的方法,优化不仅为准确性,但也为稳定性和鲁棒性的基础神经网络,一个标准,是不同于其他的。

英文摘要:

Convolutional and Recurrent, deep neural networks have been successful in machine learning systems for computer vision, reinforcement learning, and other allied fields. However, the robustness of such neural networks is seldom apprised, especially after high classification accuracy has been attained. In this paper, we evaluate the robustness of three recurrent neural networks to tiny perturbations, on three widely used datasets, to argue that high accuracy does not always mean a stable and a robust (to bounded perturbations, adversarial attacks, etc.) system. Especially, normalizing the spectrum of the discrete recurrent network to bound the spectrum (using power method, Rayleigh quotient, etc.) on a unit disk produces stable, albeit highly non-robust neural networks. Furthermore, using the $ε$-pseudo-spectrum, we show that training of recurrent networks, say using gradient-based methods, often result in non-normal matrices that may or may not be diagonalizable. Therefore, the open problem lies in constructing methods that optimize not only for accuracy but also for the stability and the robustness of the underlying neural network, a criterion that is distinct from the other.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑