采用Fowler-Nordheim动态模拟存储器的自适应突触阵列
An Adaptive Synaptic Array using Fowler-Nordheim Dynamic Analog Memory
摘要:
在本文中,我们提出了一个突触阵列,使用动态状态来实现一个模拟存储器的能量有效的训练机器学习(ML)系统。每个模拟存储器元件是由Fowler-Nordheim(FN)量子隧穿的物理学驱动的微动力学系统,而系统级学习将存储器集合的状态轨迹朝向最优解调制。我们表明,调制所需的外部能量可以匹配到学习的动态和权重衰减,从而导致ML训练过程中消耗的能量显着减少。由于每次内存更新的能耗低至5 fJ,编程分辨率高达14位,因此所提出的突触阵列可用于解决人工智能(AI)系统中观察到的训练和推理阶段之间的能效不平衡。
英文摘要:
In this paper we present a synaptic array that uses dynamical states to implement an analog memory for energy-efficient training of machine learning (ML) systems. Each of the analog memory elements is a micro-dynamical system that is driven by the physics of Fowler-Nordheim (FN) quantum tunneling, whereas the system level learning modulates the state trajectory of the memory ensembles towards the optimal solution. We show that the extrinsic energy required for modulation can be matched to the dynamics of learning and weight decay leading to a significant reduction in the energy-dissipated during ML training. With the energy-dissipation as low as 5 fJ per memory update and a programming resolution up to 14 bits, the proposed synapse array could be used to address the energy-efficiency imbalance between the training and the inference phases observed in artificial intelligence (AI) systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。