arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1408.3215cs.NEcs.ET
收藏

用热力学RAM进行皮层处理

Cortical Processing with Thermodynamic-RAM

M. Alexander Nugent, Timothy W. Molter

摘要:

AHaH计算形成了一个理论框架,从这个框架中可以构建一种生物启发类型的计算架构,与冯·诺依曼系统不同,内存和处理器在物理上结合在一起。在本文中,我们报告了一个渐进的步骤,超越了AHaH计算的理论框架,发展了一个基于忆阻器的物理神经处理单元(NPU),我们称之为热力学RAM(kT-RAM)。虽然这种NPU在机器学习应用中相对于冯·诺依曼架构的功耗和速度优势是很好理解的,但热力学RAM提供了优于其他硬件方法的适应和学习的几个优点。优点包括通用用途、简单而灵活的指令集以及易于集成到现有数字平台中。本文给出了kT-RAM的一个高层设计及其指令集的形式化定义。我们报告完成了一个kT-RAM仿真器和所有以前的机器学习基准应用程序,包括无监督聚类,监督和无监督分类,复杂信号预测,无监督机器人驱动和组合优化的成功端口。最后,我们扩展了以前的MNIST手写数字基准测试应用程序,表明在训练阶段(愈合)单独读取AHaH节点的突触状态的额外步骤导致可塑性,提高了分类器的性能,使我们最好的F1分数达到99.5%。

英文摘要:

AHaH computing forms a theoretical framework from which a biologically-inspired type of computing architecture can be built where, unlike von Neumann systems, memory and processor are physically combined. In this paper we report on an incremental step beyond the theoretical framework of AHaH computing toward the development of a memristor-based physical neural processing unit (NPU), which we call Thermodynamic-RAM (kT-RAM). While the power consumption and speed dominance of such an NPU over von Neumann architectures for machine learning applications is well appreciated, Thermodynamic-RAM offers several advantages over other hardware approaches to adaptation and learning. Benefits include general-purpose use, a simple yet flexible instruction set and easy integration into existing digital platforms. We present a high level design of kT-RAM and a formal definition of its instruction set. We report the completion of a kT-RAM emulator and the successful port of all previous machine learning benchmark applications including unsupervised clustering, supervised and unsupervised classification, complex signal prediction, unsupervised robotic actuation and combinatorial optimization. Lastly, we extend a previous MNIST hand written digits benchmark application, to show that an extra step of reading the synaptic states of AHaH nodes during the train phase (healing) alone results in plasticity that improves the classifier's performance, bumping our best F1 score up to 99.5%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑