arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.16062q-bio.NCcs.AIcs.CL
收藏

基于神经网络的语义空间认知图的形成与抽象概念的涌现

Neural Network based Formation of Cognitive Maps of Semantic Spaces and the Emergence of Abstract Concepts

University Erlangen-Nuremberg(埃尔朗根-纽伦堡大学);University Hospital Erlangen(埃尔朗根大学医院)

Paul Stoewer, Achim Schilling, Andreas Maier, Patrick Krauss

摘要:

内嗅复合体在记忆和思维的组织中起着重要作用。通过位置和网格细胞形成和导航任意心理空间的认知地图可以作为记忆和经验及其相互关系的表示。提出了多尺度后继表示作为位置和网格单元计算的数学原理。在这里,我们提出了一个神经网络,它学习基于32种不同的动物物种编码为特征向量的语义空间的认知地图。神经网络成功地学习了不同动物物种之间的相似性,并基于后继表示原理构建了“动物空间”的认知地图,其准确率约为30%,接近理论最大值,因为所有动物物种都有一个以上的可能后继,即特征空间中的最近邻。此外,分层结构,即不同尺度的认知地图,可以基于多尺度后继表示来建模。我们发现,在细粒度的认知地图,动物向量均匀分布在特征空间。相比之下,在粗粒度地图中,动物病媒根据其生物类别(即两栖动物、哺乳动物和昆虫)高度聚类。这可能是解释新的抽象语义概念出现的一种可能机制。最后,即使是全新的或不完整的输入,也可以通过从认知图中插值表示来表示,其精确度高达95%。我们的结论是,后继表示可以作为过去的记忆和经验的加权指针,因此可能是未来机器学习的关键构建块,包括先验知识,并从新的输入中获得上下文知识。

英文摘要:

The hippocampal-entorhinal complex plays a major role in the organization of memory and thought. The formation of and navigation in cognitive maps of arbitrary mental spaces via place and grid cells can serve as a representation of memories and experiences and their relations to each other. The multi-scale successor representation is proposed to be the mathematical principle underlying place and grid cell computations. Here, we present a neural network, which learns a cognitive map of a semantic space based on 32 different animal species encoded as feature vectors. The neural network successfully learns the similarities between different animal species, and constructs a cognitive map of 'animal space' based on the principle of successor representations with an accuracy of around 30% which is near to the theoretical maximum regarding the fact that all animal species have more than one possible successor, i.e. nearest neighbor in feature space. Furthermore, a hierarchical structure, i.e. different scales of cognitive maps, can be modeled based on multi-scale successor representations. We find that, in fine-grained cognitive maps, the animal vectors are evenly distributed in feature space. In contrast, in coarse-grained maps, animal vectors are highly clustered according to their biological class, i.e. amphibians, mammals and insects. This could be a possible mechanism explaining the emergence of new abstract semantic concepts. Finally, even completely new or incomplete input can be represented by interpolation of the representations from the cognitive map with remarkable high accuracy of up to 95%. We conclude that the successor representation can serve as a weighted pointer to past memories and experiences, and may therefore be a crucial building block for future machine learning to include prior knowledge, and to derive context knowledge from novel input.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑