重新思考人工神经网络:具有存储和预测数据的中央机制的子网网格
Rethinking the Artificial Neural Networks: A Mesh of Subnets with a Central Mechanism for Storing and Predicting the Data
摘要:
人工神经网络(ANN)最初被设计成像生物神经网络一样工作,但ANN真的像生物神经网络一样工作吗?正如我们所知,人类大脑将信息保存在其存储单元中,因此如果ANN使用与我们大脑相同的模型,它们应该以类似的方式存储数据集。最流行的人工神经网络架构类型是基于神经元的分层结构,而人脑有数万亿个复杂的神经元互连,不断建立新的连接,更新现有的连接,并删除大脑不同部分之间的不相关连接。在本文中,我们提出了一种新的方法来建立人工神经网络,这是真正的灵感来自于生物网络包含一个由中央机制控制的网格。子网是保存数据集值的神经元网络。我们试图解决以下基本问题:(1)ANN模型的体系结构是什么?分层架构是否是最合适的选择?(2)神经元是一个过程还是一个存储单元?(3)连接神经元的最佳方式是什么?应该使用什么样的权重分配机制?(4)如何将先验知识、偏差和泛化用于特征提取和预测?我们提出的人工神经网络架构利用文本数据的准确性,我们的实验结果证实了我们的模型的有效性。我们还合作构建用于存储和处理图像的ANN模型。
英文摘要:
The Artificial Neural Networks (ANNs) have been originally designed to function like a biological neural network, but does an ANN really work in the same way as a biological neural network? As we know, the human brain holds information in its memory cells, so if the ANNs use the same model as our brains, they should store datasets in a similar manner. The most popular type of ANN architecture is based on a layered structure of neurons, whereas a human brain has trillions of complex interconnections of neurons continuously establishing new connections, updating existing ones, and removing the irrelevant connections across different parts of the brain. In this paper, we propose a novel approach to building ANNs which are truly inspired by the biological network containing a mesh of subnets controlled by a central mechanism. A subnet is a network of neurons that hold the dataset values. We attempt to address the following fundamental questions: (1) What is the architecture of the ANN model? Whether the layered architecture is the most appropriate choice? (2) Whether a neuron is a process or a memory cell? (3) What is the best way of interconnecting neurons and what weight-assignment mechanism should be used? (4) How to incorporate prior knowledge, bias, and generalizations for features extraction and prediction? Our proposed ANN architecture leverages the accuracy on textual data and our experimental findings confirm the effectiveness of our model. We also collaborate with the construction of the ANN model for storing and processing the images.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。