arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.04836cs.ETcond-mat.stat-mechcs.AI
收藏

面向AI应用的热力学计算系统

Thermodynamic Computing System for AI Applications

Normal Computing Corporation(Normal计算公司)

Denis Melanson, Mohammad Abu Khater, Maxwell Aifer, Kaelan Donatella, Max Hunter Gordon, Thomas Ahle, Gavin Crooks, Antonio J. Martinez, Faris Sbahi, Patrick J. Coles

AI总结:

本文提出首个连续变量热力学计算机SPU,基于全连接RLC单元胞实现高斯采样、矩阵求逆及神经网络不确定性量化,为低功耗加速概率式AI提供新硬件路径。

摘要:

人工智能(AI)算法近期的突破凸显了对新型计算硬件的需求,以便真正释放AI的潜力。基于物理的硬件(例如热力学计算)有潜力提供快速、低功耗的手段来加速AI基础操作,尤其是生成式AI和概率式AI。在本研究中,我们展示了首台连续变量热力学计算机,并将其命名为随机处理单元(SPU)。我们的SPU由作为单元胞的RLC电路构成,制作在一块印刷电路板上,包含8个单元胞,这些单元胞通过开关电容实现全连接耦合。它既可用于采样,也可用于线性代数基础操作;我们在该硬件上演示了高斯采样和矩阵求逆。后者代表了首次热力学线性代数实验。我们还说明了SPU在神经网络分类的不确定性量化中的适用性。我们设想,当该硬件在规模上扩大后,将对加速各类概率式AI应用产生重大影响。

英文摘要:

Recent breakthroughs in artificial intelligence (AI) algorithms have highlighted the need for novel computing hardware in order to truly unlock the potential for AI. Physics-based hardware, such as thermodynamic computing, has the potential to provide a fast, low-power means to accelerate AI primitives, especially generative AI and probabilistic AI. In this work, we present the first continuous-variable thermodynamic computer, which we call the stochastic processing unit (SPU). Our SPU is composed of RLC circuits, as unit cells, on a printed circuit board, with 8 unit cells that are all-to-all coupled via switched capacitances. It can be used for either sampling or linear algebra primitives, and we demonstrate Gaussian sampling and matrix inversion on our hardware. The latter represents the first thermodynamic linear algebra experiment. We also illustrate the applicability of the SPU to uncertainty quantification for neural network classification. We envision that this hardware, when scaled up in size, will have significant impact on accelerating various probabilistic AI applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑