在线学习极简学习机与低复杂度预测可塑性规则及FPGA实现
Online Learning Extreme Learning Machine with Low-Complexity Predictive Plasticity Rule and FPGA Implementation
AI总结:
本文提出了一种基于低复杂度预测可塑性规则的极简学习机,通过FPGA实现显著降低计算复杂度并提升边缘设备的能效。
摘要:
我们提出了一种简化且生物启发的预测局部学习规则,该规则消除了传统神经网络中全局反向传播和基于事件的训练中的膜整合需求。权重更新仅在预测误差触发,并通过稀疏、二进制驱动的向量加法进行。我们将此规则整合到极简学习机(ELM)中,替代了传统计算密集型的矩阵求逆。与标准ELM相比,我们的方法在隐藏层有M个节点时,将训练复杂度从O(M^3)降低到O(M),同时保持可比的精度(在训练和测试数据集上分别降级3.6%和2.0%)。我们展示了FPGA实现,并将其与现有研究进行比较,显示了显著的计算和内存需求减少。该设计展示了在低成本边缘设备上实现高效在线学习的强大潜力。
英文摘要:
We propose a simplified, biologically inspired predictive local learning rule that eliminates the need for global backpropagation in conventional neural networks and membrane integration in event-based training. Weight updates are triggered only on prediction errors and are performed using sparse, binary-driven vector additions. We integrate this rule into an extreme learning machine (ELM), replacing the conventional computationally intensive matrix inversion. Compared to standard ELM, our approach reduces the complexity of the training from O(M^3) to O(M), in terms of M nodes in the hidden layer, while maintaining comparable accuracy (within 3.6% and 2.0% degradation on training and test datasets, respectively). We demonstrate an FPGA implementation and compare it with existing studies, showing significant reductions in computational and memory requirements. This design demonstrates strong potential for energy-efficient online learning on low-cost edge devices.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。