Recently there has been increasing activity to build dedicated Ising Machines to accelerate the solution of combinatorial optimization problems by expressing these problems as a ground-state search of the Ising model. A common theme of such Ising Machines is to tailor the physics of underlying hardware to the mathematics of the Ising model to improve some aspect of performance that is measured in speed to solution, energy consumption per solution or area footprint of the adopted hardware. One such approach to build an Ising spin, or a binary stochastic neuron (BSN), is a compact mixed-signal unit based on a low-barrier nanomagnet based design that uses a single magnetic tunnel junction (MTJ) and three transistors (3T-1MTJ) where the MTJ functions as a stochastic resistor (1SR). Such a compact unit can drastically reduce the area footprint of BSNs while promising massive scalability by leveraging the existing Magnetic RAM (MRAM) technology that has integrated 1T-1MTJ cells in ~Gbit densities. The 3T-1SR design however can be realized using different materials or devices that provide naturally fluctuating resistances. Extending previous work, we evaluate hardware BSNs from this general perspective by classifying necessary and sufficient conditions to design a fast and energy-efficient BSN that can be used in scaled Ising Machine implementations. We connect our device analysis to systems-level metrics by emphasizing hardware-independent figures-of-merit such as flips per second and dissipated energy per random bit that can be used to classify any Ising Machine.
Thermal-Aware Compilation of Spiking Neural Networks to Neuromorphic Hardware
类脑计算的硬件实现可以显著提高用脉冲神经网络(SNN)实现的机器学习任务的性能和能量效率,使得这些硬件平台特别适合于嵌入式系统和其他能量受限的环境。我们观察到,当通过其突触元件传播尖峰时,硬件的交叉开关中的长位线和字线产生显著的电流变化,突触元件通常设计有非易失性存储器(NVM)。这样的电流变化在硬件的每个交叉杆内创建热梯度,这取决于机器学习工作负载以及工作负载的神经元和突触到这些交叉杆的映射。\mr{This thermal gradient becomes significant at scaled technology nodes and it increases the leakage power in the hardware leading to an increase in the energy consumption.}我们提出了一种新的技术,将基于SNN的机器学习工作负载的神经元和突触映射到神经形态硬件。我们做了两个新的贡献。首先,我们制定了一个详细的热模型的神经形态硬件中的交叉杆纳入工作负载的依赖性,其中每个基于NVM的突触细胞的温度计算考虑其相邻细胞的热贡献。其次,我们将这个热模型的映射神经元和突触的SNN为基础的工作负载使用爬山启发式。其目的是减少交叉杆中的热梯度。我们使用最先进的神经形态硬件的10个机器学习工作负载来评估我们的神经元和突触映射技术。我们证明…
Integrated multi-operand optical neurons for scalable and hardware-efficient deep learning
Microelectronics Research Center, The University of Texas at Austin(得克萨斯大学奥斯汀分校微电子研究中心);Department of Electrical and Computer Engineering, The University of Texas at Austin(得克萨斯大学奥斯汀分校电气与计算机工程系);Omega Optics, Inc.(欧米茄光学公司)
Choose your tools carefully: A Comparative Evaluation of Deterministic vs. Stochastic and Binary vs. Analog Neuron models for Implementing Emerging Computing Paradigms
Training slow silicon neurons to control extremely fast robots with spiking reinforcement learning
Institute of Neuroinformatics, UZH and ETH Zurich(神经信息研究所,苏黎世联邦理工学院和苏黎世联邦理工学院);Istituto Italiano di Tecnologia(意大利技术研究所);Technical University of Munich(慕尼黑技术大学);Natl. Center for Radiation Protection and Computational Physics, Istituto Superiore di Sanità(辐射防护与计算物理国家中心,意大利卫生超级研究所);Digital Society Initiative, University of Zurich(数字社会倡议,苏黎世大学)