A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challenges
University of California, Berkeley(加州大学伯克利分校);Research Institutes of Sweden(瑞典研究院);International Research and Training Center for Information Technologies and Systems(国际信息技术与系统研究培训中心);Luleå University of Technology(吕勒奥理工大学);IBM Research(IBM研究院)
Denis Kleyko, Dmitri A. Rachkovskij, Evgeny Osipov, Abbas Rahimi
This is Part II of the two-part comprehensive survey devoted to a computing framework most commonly known under the names Hyperdimensional Computing and Vector Symbolic Architectures (HDC/VSA). Both names refer to a family of computational models that use high-dimensional distributed representations and rely on the algebraic properties of their key operations to incorporate the advantages of structured symbolic representations and vector distributed representations. Holographic Reduced Representations is an influential HDC/VSA model that is well-known in the machine learning domain and often used to refer to the whole family. However, for the sake of consistency, we use HDC/VSA to refer to the field. Part I of this survey covered foundational aspects of the field, such as the historical context leading to the development of HDC/VSA, key elements of any HDC/VSA model, known HDC/VSA models, and the transformation of input data of various types into high-dimensional vectors suitable for HDC/VSA. This second part surveys existing applications, the role of HDC/VSA in cognitive computing and architectures, as well as directions for future work. Most of the applications lie within the Machine Learning/Artificial Intelligence domain, however, we also cover other applications to provide a complete picture. The survey is written to be useful for both newcomers and practitioners.
A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations
University of California, Berkeley(加州大学伯克利分校);Research Institutes of Sweden(瑞典研究所);International Research and Training Center for Information Technologies and Systems(国际信息技术与系统研究培训中心);Luleå University of Technology(吕勒奥理工大学);IBM Research(IBM研究院)
VS-Graph: Scalable and Efficient Graph Classification Using Hyperdimensional Computing
Department of Electrical and Computer Engineering, George Mason University, Fairfax, VA, USA(电气与计算机工程系,乔治·马歇尔大学,弗吉尼亚州 Fairfax);Oak Ridge National Laboratory, Oak Ridge, TN, USA(橡树岭国家实验室,橡树岭,田纳西州)
Recursive Binding for Similarity-Preserving Hypervector Representations of Sequences
International Research and Training Center for Information Technologies and Systems(国际信息技术与系统研究培训中心);Luleå University of Technology(吕勒奥理工大学);University of California at Berkeley(加州大学伯克利分校);Research Institutes of Sweden(瑞典研究院)
Moscow Institute of Physics and Technology(莫斯科物理技术学院);AIRI;Federal Research Center “Computer Science and Control” of the Russian Academy of Sciences(俄罗斯科学院“计算机科学与控制”联邦研究中心)
Learning Holographic Reduced Representations with Clifford Variational Autoencoders
Institute of Neuroinformatics(神经信息学研究所);University of Zurich & ETH Zurich(苏黎世大学与苏黎世联邦理工学院);National Research Council Canada(加拿大国家研究委员会);University of Waterloo(滑铁卢大学)