arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.06145cs.CV
收藏

用于训练脉冲神经网络的神经形态数据增强

Neuromorphic Data Augmentation for Training Spiking Neural Networks

Yale University(耶鲁大学)

Yuhang Li, Youngeun Kim, Hyoungseob Park, Tamar Geller, Priyadarshini Panda

摘要:

利用脉冲神经网络(SNN)在基于事件的数据集上开发神经形态智能最近引起了广泛的研究关注。然而,基于事件的数据集的有限大小使得SNN容易过拟合和不稳定的收敛。这一问题尚未被以往的学术著作所探讨。为了最大限度地减少这种泛化差距,我们提出了神经形态数据增强(NDA),这是一系列专门为基于事件的数据集设计的几何增强,其目标是显着稳定SNN训练并减少训练和测试性能之间的泛化差距。该方法简单,与现有的SNN训练管道兼容。使用所提出的增强,第一次,我们证明了SNN的无监督对比学习的可行性。我们进行全面的实验,流行的神经形态视觉基准,并表明,NDA产生实质性的改善,比以前的国家的最先进的结果。例如,基于NDA的SNN在CIFAR 10-DVS和N-Caltech 101上分别实现了10.1%和13.7%的精度增益。代码可在GitHub https://github.com/Intelligent-Computing-Lab-Yale/NDA_SNN上获得

英文摘要:

Developing neuromorphic intelligence on event-based datasets with Spiking Neural Networks (SNNs) has recently attracted much research attention. However, the limited size of event-based datasets makes SNNs prone to overfitting and unstable convergence. This issue remains unexplored by previous academic works. In an effort to minimize this generalization gap, we propose Neuromorphic Data Augmentation (NDA), a family of geometric augmentations specifically designed for event-based datasets with the goal of significantly stabilizing the SNN training and reducing the generalization gap between training and test performance. The proposed method is simple and compatible with existing SNN training pipelines. Using the proposed augmentation, for the first time, we demonstrate the feasibility of unsupervised contrastive learning for SNNs. We conduct comprehensive experiments on prevailing neuromorphic vision benchmarks and show that NDA yields substantial improvements over previous state-of-the-art results. For example, the NDA-based SNN achieves accuracy gain on CIFAR10-DVS and N-Caltech 101 by 10.1% and 13.7%, respectively. Code is available on GitHub https://github.com/Intelligent-Computing-Lab-Yale/NDA_SNN

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑