arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.05268cs.ARcs.AI
收藏

向量符号架构作为新兴硬件的计算框架

Vector Symbolic Architectures as a Computing Framework for Emerging Hardware

University of California at Berkeley(加州大学伯克利分校);Research Institutes of Sweden(瑞典研究院);Intel Labs(英特尔实验室)
Denis Kleyko, Mike Davies, E. Paxon Frady, Pentti Kanerva, Spencer J. Kent, Bruno A. Olshausen, Evgeny Osipov, Jan M. Rabaey, Dmitri A. Rachkovskij, Abbas Rahim… 展开作者

Denis Kleyko, Mike Davies, E. Paxon Frady, Pentti Kanerva, Spencer J. Kent, Bruno A. Olshausen, Evgeny Osipov, Jan M. Rabaey, Dmitri A. Rachkovskij, Abbas Rahimi, Friedrich T. Sommer

AI总结:

本文综述了向量符号架构(VSA,即超维计算)的研究进展,阐述其类域代数结构、叠加计算特性与计算通用性,指出其可作为新兴硬件的抽象层,为AI相关计算与硬件实现提供新路径。

摘要:

本文综述了向量符号架构(VSA,也称为超维计算)这一计算框架的最新研究进展。该框架非常适合在随机的新兴硬件中实现,并且能够自然地表达人工智能(AI)所需的各类认知操作。本文证明,VSA的类域代数结构可在高维向量上提供简单但强大的操作,能够支撑现代计算中所有相关的数据结构与操作。此外,本文阐述了VSA区别于传统计算的核心特征——“叠加计算”,这一特性也为高效解决AI应用中固有的复杂组合搜索问题提供了可能。本文还概述了证明VSA具备计算通用性的方法。研究认为VSA可作为一种采用分布式表示的计算框架,充当新兴计算硬件的抽象层。本文可为计算机架构研究者提供参考,阐释了VSA背后的理念、基于VSA的分布式计算技术,以及其与神经形态计算等新兴计算硬件的相关性。

英文摘要:

This article reviews recent progress in the development of the computing framework vector symbolic architectures (VSA) (also known as hyperdimensional computing). This framework is well suited for implementation in stochastic, emerging hardware, and it naturally expresses the types of cognitive operations required for artificial intelligence (AI). We demonstrate in this article that the field-like algebraic structure of VSA offers simple but powerful operations on high-dimensional vectors that can support all data structures and manipulations relevant to modern computing. In addition, we illustrate the distinguishing feature of VSA, "computing in superposition," which sets it apart from conventional computing. It also opens the door to efficient solutions to the difficult combinatorial search problems inherent in AI applications. We sketch ways of demonstrating that VSA are computationally universal. We see them acting as a framework for computing with distributed representations that can play a role of an abstraction layer for emerging computing hardware. This article serves as a reference for computer architects by illustrating the philosophy behind VSA, techniques of distributed computing with them, and their relevance to emerging computing hardware, such as neuromorphic computing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑