arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.06506cs.ETcs.AIcs.ARcs.LG
收藏

基于忆阻随机计算的深度学习参数优化

Memristive Stochastic Computing for Deep Learning Parameter Optimization

College of Science and Engineering, James Cook University(詹姆斯库克大学科学与工程学院);University of Michigan(密歇根大学)

Corey Lammie, Jason K. Eshraghian, Wei D. Lu, Mostafa Rahimi Azghadi

摘要:

随机计算(SC)是一种计算范式,它允许使用随机比特流和数字逻辑进行各种算术运算的低成本和低功耗计算。与二进制域中使用的传统表示方案相比,随机域中的比特流序列是无关紧要的,并且计算通常是不确定的。在这篇简报中,我们利用概率传导桥接RAM(CBRAM)设备切换期间的随机性来有效地生成随机比特流,以便执行深度学习(DL)参数优化,将乘法和累加(MAC)单元的大小减少5个数量级。我们证明,在使用40纳米互补金属氧化物半导体(CMOS)工艺,我们的可扩展架构占用1.55毫米$^2$和消耗约167 $μ$ W时,优化参数的卷积神经网络(CNN),而它正在接受训练的字符识别任务,观察没有显着减少训练后的准确性。

英文摘要:

Stochastic Computing (SC) is a computing paradigm that allows for the low-cost and low-power computation of various arithmetic operations using stochastic bit streams and digital logic. In contrast to conventional representation schemes used within the binary domain, the sequence of bit streams in the stochastic domain is inconsequential, and computation is usually non-deterministic. In this brief, we exploit the stochasticity during switching of probabilistic Conductive Bridging RAM (CBRAM) devices to efficiently generate stochastic bit streams in order to perform Deep Learning (DL) parameter optimization, reducing the size of Multiply and Accumulate (MAC) units by 5 orders of magnitude. We demonstrate that in using a 40-nm Complementary Metal Oxide Semiconductor (CMOS) process our scalable architecture occupies 1.55mm$^2$ and consumes approximately 167$μ$W when optimizing parameters of a Convolutional Neural Network (CNN) while it is being trained for a character recognition task, observing no notable reduction in accuracy post-training.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑