The double descent curve is one of the most intriguing properties of deep neural networks. It contrasts the classical bias-variance curve with the behavior of modern neural networks, occurring where the number of samples nears the number of parameters. In this work, we explore the connection between the double descent phenomena and the number of samples in the deep neural network setting. In particular, we propose a construction which augments the existing dataset by artificially increasing the number of samples. This construction empirically mitigates the double descent curve in this setting. We reproduce existing work on deep double descent, and observe a smooth descent into the overparameterized region for our construction. This occurs both with respect to the model size, and with respect to the number epochs.
Towards Reliable Evaluation of Adversarial Robustness for Spiking Neural Networks
Brain-inspired Cognitive AI Lab, Institute of Automation, Chinese Academy of Sciences(脑启发认知人工智能实验室,自动化研究所,中国科学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学);Beijing Institute of AI Safety and Governance(北京人工智能安全与治理研究院);Beijing Key Laboratory of Safe Al and Superalignment(北京安全人工智能与超对齐重点实验室);Center for Long-term AI(长期人工智能中心)
The Pitfalls of Simplicity Bias in Neural Networks
Microsoft Research(微软研究院);Stanford University(斯坦福大学)
一些研究提出了简单性偏差(SB)--标准训练程序(如随机梯度下降(SGD))寻找简单模型的趋势--来证明为什么神经网络泛化良好[Arpit et al. 2017,Nakkiran et al. 2019,Soudry et al. 2018]。然而,简单性的确切概念仍然模糊。此外,以前使用SB从理论上证明神经网络泛化能力良好的设置没有同时捕获神经网络的非鲁棒性--这是一种在实践中广泛观察到的现象[Goodfellow et al. 2014,Jo and Bengio 2017]。我们试图通过设计数据集来协调SB和神经网络的高级标准泛化与实践中观察到的非鲁棒性,这些数据集(a)包含精确的简单性概念,(b)包含具有不同简单性水平的多个预测特征,(c)捕获在真实数据上训练的神经网络的非鲁棒性。通过对这些数据集的理论和分析,我们得出了四个观察结果:(i)SGD和变体的SB可能是极端的:神经网络可以完全依赖于最简单的特征,并且对所有预测性复杂特征保持不变。(ii)SB的极端方面可以解释为什么看似良性的分布偏移和小的对抗性扰动会显著降低模型性能。(iii)与传统观点相反,SB也会损害相同数据分布的泛化,因为即使最简单的特征的预测能力低于更复杂的特征,SB也会持续存在。(iv)提高泛化和鲁棒性的常用方法--集成和对抗训练--可能无法减轻SB及其陷阱。鉴于SB在训练神经网络中的作用,我们希望所…