arXiv 2507.029012025-10-16cs.NEcs.CVcs.LG

基于睡眠增强潜在重放与脉冲神经网络的在线持续学习

Online Continual Learning via Spiking Neural Networks with Sleep Enhanced Latent Replay

Erliang Lin, Wenbin Luo, Wei Jia, Yu Chen, Shaofu Yang

备注：: There are some errors in the data of the paper. It will take some time to conduct additional experiments for adjustment. We hope to temporarily withdraw the preprint to prevent misleading others

阅读 PDF

arXiv 页面 ↗HTML 原文 ↗

AI总结：

针对边缘计算中在线持续学习的高内存开销和类别偏差问题，提出SESLR方法，结合脉冲神经网络与睡眠增强潜在重放，显著降低内存并提升准确率。

摘要：

边缘计算场景需要开发硬件高效的在线持续学习算法以适应动态环境。然而，现有算法常常面临高内存开销和对近期训练任务的偏差问题。为解决这些问题，本文提出了一种新颖的在线持续学习方法，称为SESLR，它将睡眠增强的潜在重放方案与脉冲神经网络（SNNs）相结合。SESLR利用SNNs的二进制脉冲特性以单比特存储重放特征，显著降低了内存开销。此外，受生物睡眠-觉醒周期的启发，SESLR引入了一个噪声增强的睡眠阶段，在该阶段模型仅对带有受控噪声注入的重放样本进行训练，有效缓解了对新类别的分类偏差。在传统数据集（MNIST、CIFAR10）和神经形态数据集（NMNIST、CIFAR10-DVS）上的大量实验证明了SESLR的有效性。在Split CIFAR10上，与基线方法相比，SESLR在平均准确率上实现了近30%的提升，而内存消耗仅为基线的三分之一。在Split CIFAR10-DVS上，其准确率提高了约10%，同时内存开销减少了32倍。这些结果验证了SESLR作为资源受限边缘计算场景中在线持续学习的一种有前景的解决方案。

英文摘要：

Edge computing scenarios necessitate the development of hardware-efficient online continual learning algorithms to be adaptive to dynamic environment. However, existing algorithms always suffer from high memory overhead and bias towards recently trained tasks. To tackle these issues, this paper proposes a novel online continual learning approach termed as SESLR, which incorporates a sleep enhanced latent replay scheme with spiking neural networks (SNNs). SESLR leverages SNNs' binary spike characteristics to store replay features in single bits, significantly reducing memory overhead. Furthermore, inspired by biological sleep-wake cycles, SESLR introduces a noise-enhanced sleep phase where the model exclusively trains on replay samples with controlled noise injection, effectively mitigating classification bias towards new classes. Extensive experiments on both conventional (MNIST, CIFAR10) and neuromorphic (NMNIST, CIFAR10-DVS) datasets demonstrate SESLR's effectiveness. On Split CIFAR10, SESLR achieves nearly 30% improvement in average accuracy with only one-third of the memory consumption compared to baseline methods. On Split CIFAR10-DVS, it improves accuracy by approximately 10% while reducing memory overhead by a factor of 32. These results validate SESLR as a promising solution for online continual learning in resource-constrained edge computing scenarios.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。