arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.13398cs.NEcs.LGq-bio.NC
收藏

SpikE:面向多关系图数据的基于脉冲的嵌入方法

SpikE: spike-based embeddings for multi-relational graph data

Siemens AI Lab Siemens AG Technology(西门子股份公司技术部西门子人工智能实验室)

Dominik Dold, Josep Soler Garrido

AI总结:

该研究提出SpikE基于脉冲的图嵌入算法,用神经元群体脉冲时间和时间差分别表示知识图谱节点与关系,兼容脉冲神经网络训练框架且适配神经形态硬件,拓展了其工业应用场景。

摘要:

尽管近年来基于脉冲的编码与误差反向传播算法的结合取得了成功,但脉冲神经网络仍大多应用于感觉处理相关任务,处理视觉或听觉数据等传统数据结构。知识图谱是一种在工业和研究中得到广泛应用的丰富数据表示形式,它是一种基于图的结构,其中实体表示为节点,实体间的关系表示为边。分子、社交网络和工业工厂系统等复杂系统都可以用知识图谱的通用语言来描述,这使得图嵌入算法能够在这些信息密集的环境中做出具备上下文感知能力的预测。我们提出了一种基于脉冲的算法,其中图中的节点由神经元群体的单个脉冲时间表示,而关系由群体间的脉冲时间差表示。学习此类基于脉冲的嵌入仅需要关于脉冲时间和脉冲时间差的知识,与最近提出的脉冲神经网络训练框架兼容。所提出的模型可以轻松映射到当前的神经形态硬件系统,从而将知识图谱上的推理推进到这类架构擅长的领域,为该技术解锁了一个颇具前景的工业应用方向。

英文摘要:

Despite the recent success of reconciling spike-based coding with the error backpropagation algorithm, spiking neural networks are still mostly applied to tasks stemming from sensory processing, operating on traditional data structures like visual or auditory data. A rich data representation that finds wide application in industry and research is the so-called knowledge graph - a graph-based structure where entities are depicted as nodes and relations between them as edges. Complex systems like molecules, social networks and industrial factory systems can be described using the common language of knowledge graphs, allowing the usage of graph embedding algorithms to make context-aware predictions in these information-packed environments. We propose a spike-based algorithm where nodes in a graph are represented by single spike times of neuron populations and relations as spike time differences between populations. Learning such spike-based embeddings only requires knowledge about spike times and spike time differences, compatible with recently proposed frameworks for training spiking neural networks. The presented model is easily mapped to current neuromorphic hardware systems and thereby moves inference on knowledge graphs into a domain where these architectures thrive, unlocking a promising industrial application area for this technology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑