利用神经忆阻纳米线网络中的自适应动力学进行迁移学习
Harnessing adaptive dynamics in neuro-memristive nanowire networks for transfer learning
摘要:
纳米线网络(NWNs)代表了一种独特的神经形态信息处理的硬件平台。除了在它们的交叉点结处表现出类似突触的电阻开关存储器之外,它们的自组装还赋予它们的电路类似神经网络的拓扑结构,这是通过传统的自上而下的制造方法不可能实现的。除了它们的低功耗要求、成本效益和高效互连之外,神经形态NWN还具有容错和自我修复能力。这些非常有吸引力的性质可以在很大程度上归因于它们复杂的网络连接,这使得丰富的自适应非线性动力学,包括混沌边缘临界。在这里,我们展示了如何利用神经形态NWN固有的自适应动态来实现迁移学习。我们证明了这一点,通过模拟的水库计算的实现,其中NWNs执行著名的基准任务的麦基玻璃(MG)信号预测。首先,我们展示了NWNs如何预测MG信号与任意程度的不可预测性(即混乱)。然后,我们表明,NWNs预暴露于MG信号的预测比NWNs没有先前的经验MG信号。这种类型的迁移学习是由网络对先前状态的集体记忆实现的。总的来说,它们的自适应信号处理能力使神经形态NWN成为物联网设备中新兴实时应用的有希望的候选者,特别是在远边缘。
英文摘要:
Nanowire networks (NWNs) represent a unique hardware platform for neuromorphic information processing. In addition to exhibiting synapse-like resistive switching memory at their cross-point junctions, their self-assembly confers a neural network-like topology to their electrical circuitry, something that is impossible to achieve through conventional top-down fabrication approaches. In addition to their low power requirements, cost effectiveness and efficient interconnects, neuromorphic NWNs are also fault-tolerant and self-healing. These highly attractive properties can be largely attributed to their complex network connectivity, which enables a rich repertoire of adaptive nonlinear dynamics, including edge-of-chaos criticality. Here, we show how the adaptive dynamics intrinsic to neuromorphic NWNs can be harnessed to achieve transfer learning. We demonstrate this through simulations of a reservoir computing implementation in which NWNs perform the well-known benchmarking task of Mackey-Glass (MG) signal forecasting. First we show how NWNs can predict MG signals with arbitrary degrees of unpredictability (i.e. chaos). We then show that NWNs pre-exposed to a MG signal perform better in forecasting than NWNs without prior experience of an MG signal. This type of transfer learning is enabled by the network's collective memory of previous states. Overall, their adaptive signal processing capabilities make neuromorphic NWNs promising candidates for emerging real-time applications in IoT devices in particular, at the far edge.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。