arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2511.01553cs.LGcs.AIcs.DCcs.NE

Intel Loihi 2 上的实时持续学习

Real-time Continual Learning on Intel Loihi 2

Institute of Informatics, University of Munich (LMU)(慕尼黑大学信息学院);Intel Labs, Intel Corporation(英特尔实验室);Southwest Research Institute(西南研究 institute);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);German Research Centre for Artificial Intelligence (DFKI)(德国人工智能研究中心);Institute of Computational Life Sciences (ICLS)(计算生命科学研究所);Zurich University of Applied Sciences (ZHAW)(苏黎世应用科学大学)

Elvin Hajizada, Danielle Rager, Timothy Shea, Leobardo Campos-Macias, Andreas Wild, Eyke Hüllermeier, Yulia Sandamirskaya, Mike Davies

AI总结:

提出CLP-SNN脉冲神经网络架构并在Intel Loihi 2芯片上实现,通过事件驱动局部学习、自归一化三因子规则及神经发生等创新,在OpenLORIS上实现高精度无重放在线持续学习,比边缘GPU快70倍且能效高5600倍。

摘要:

边缘设备上的 AI 系统在开放世界环境中面临一个关键挑战:在数据分布发生变化和出现新类别时进行适应。尽管离线训练主导了当前范式,但在线持续学习(OCL)——即模型从非平稳数据流中增量学习且不会发生灾难性遗忘——在功率受限的环境中仍然具有挑战性。我们提出了一种名为 CLP-SNN 的神经形态解决方案:一种用于持续学习原型的脉冲神经网络架构及其在 Intel Loihi 2 芯片上的实现。我们的方法引入了三项创新:(1)事件驱动且时空稀疏的局部学习,(2)维持权重归一化的自归一化三因子学习规则,以及(3)用于扩展容量和缓解遗忘的整合神经发生与元可塑性。在 OpenLORIS 少样本学习实验中,CLP-SNN 实现了与重放方法相媲美的准确度,且无需重放。CLP-SNN 带来了变革性的效率提升:比边缘 GPU 上最佳的替代 OCL 快 70 倍(0.33ms 对比 23.2ms),能效高 5,600 倍(0.05mJ 对比 281mJ)。这表明,协同设计的脑启发算法和神经形态硬件能够打破未来边缘 AI 系统传统的准确率与效率权衡。

英文摘要:

AI systems on edge devices face a critical challenge in open-world environments: adapting when data distributions shift and novel classes emerge. While offline training dominates current paradigms, online continual learning (OCL)--where models learn incrementally from non-stationary streams without catastrophic forgetting--remains challenging in power-constrained settings. We present a neuromorphic solution called CLP-SNN: a spiking neural network architecture for Continually Learning Prototypes and its implementation on Intel's Loihi 2 chip. Our approach introduces three innovations: (1) event-driven and spatiotemporally sparse local learning, (2) a self-normalizing three-factor learning rule maintaining weight normalization, and (3) integrated neurogenesis and metaplasticity for capacity expansion and forgetting mitigation. On OpenLORIS few-shot learning experiments, CLP-SNN achieves accuracy competitive with replay methods while being rehearsal-free. CLP-SNN delivers transformative efficiency gains: 70\times faster (0.33ms vs 23.2ms), and 5,600\times more energy efficient (0.05mJ vs 281mJ) than the best alternative OCL on edge GPU. This demonstrates that co-designed brain-inspired algorithms and neuromorphic hardware can break traditional accuracy-efficiency trade-offs for future edge AI systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑