Developing neuromorphic intelligence on event-based datasets with Spiking Neural Networks (SNNs) has recently attracted much research attention. However, the limited size of event-based datasets makes SNNs prone to overfitting and unstable convergence. This issue remains unexplored by previous academic works. In an effort to minimize this generalization gap, we propose Neuromorphic Data Augmentation (NDA), a family of geometric augmentations specifically designed for event-based datasets with the goal of significantly stabilizing the SNN training and reducing the generalization gap between training and test performance. The proposed method is simple and compatible with existing SNN training pipelines. Using the proposed augmentation, for the first time, we demonstrate the feasibility of unsupervised contrastive learning for SNNs. We conduct comprehensive experiments on prevailing neuromorphic vision benchmarks and show that NDA yields substantial improvements over previous state-of-the-art results. For example, the NDA-based SNN achieves accuracy gain on CIFAR10-DVS and N-Caltech 101 by 10.1% and 13.7%, respectively. Code is available on GitHub https://github.com/Intelligent-Computing-Lab-Yale/NDA_SNN
Energy-Aware Spike Budgeting for Continual Learning in Spiking Neural Networks for Neuromorphic Vision
Dept. of Electrical and Electronics Engineering, University of Liberal Arts Bangladesh(乌拉尔大学 bangladesh 电子与电气工程系);Dept. of Electrical Engineering, Pennsylvania State University(宾夕法尼亚州立大学电气工程系)
Real-Time Frame- and Event-based Object Detection with Spiking Neural Networks on Edge Neuromorphic Hardware: Design, Deployment and Benchmark
Department of Electrical and Photonics Engineering, Technical University of Denmark(电气与光子工程系,丹麦技术大学);Autonomous Systems Lab, ETH zürich(自主系统实验室,苏黎世联邦理工学院)
NeuroMoCo: A Neuromorphic Momentum Contrast Learning Method for Spiking Neural Networks
Southwest University(西南大学);Chongqing Key Laboratory of Brain Inspired Computing and Intelligent Chips(重庆脑启发计算与智能芯片重点实验室);University of Technology Sydney(悉尼科技大学)
Attention via Synaptic Plasticity is All You Need: A Biologically Inspired Spiking Neuromorphic Transformer
Department of Electronics and Communication Engineering, National Institute of Technology Allahabad, Prayagraj, 211004, India(国家理工学院阿姆利达分校电子与通信工程系);Centre for Nanotechnology, Indian Institute of Technology Roorkee, Roorkee, Uttarakhand, 247667, India(印度理工学院罗奥基分校纳米技术中心)