循环神经网络
Cyclic Neural Network
AI总结:
本文提出循环神经网络,允许神经元任意图状连接,包括循环,并开发图多层感知器模型,通过前向-前向训练算法在实验中优于反向传播,开辟了新的ANN设计范式。
摘要:
本文回答了人工神经网络(ANN)设计中的一个基本问题:我们不需要逐层顺序构建ANN来保证有向无环图(DAG)性质。受生物智能(BI)的启发,其中神经元形成复杂的图结构网络,我们引入了开创性的循环神经网络(Cyclic NNs)。它模拟了生物神经系统的灵活和动态图特性,允许神经元以任何图状结构连接,包括循环。与当前ANN的DAG结构相比,这提供了更大的适应性。我们进一步开发了图多层感知器(Graph Over Multi-layer Perceptron),这是基于这种新设计范式的第一个详细模型。在大多数泛化情况下,对广泛测试的数据集进行的实验验证了循环NN的优势,通过使用前向-前向(FF)训练算法,证明了其优于当前BP训练方法。这项研究展示了一种全新的ANN设计范式,与当前ANN设计有显著不同,可能引领更接近生物的人工智能系统。
英文摘要:
This paper answers a fundamental question in artificial neural network (ANN) design: We do not need to build ANNs layer-by-layer sequentially to guarantee the Directed Acyclic Graph (DAG) property. Drawing inspiration from biological intelligence (BI), where neurons form a complex, graph-structured network, we introduce the groundbreaking Cyclic Neural Networks (Cyclic NNs). It emulates the flexible and dynamic graph nature of biological neural systems, allowing neuron connections in any graph-like structure, including cycles. This offers greater adaptability compared to the DAG structure of current ANNs. We further develop the Graph Over Multi-layer Perceptron, which is the first detailed model based on this new design paradigm. Experimental validation of the Cyclic NN's advantages on widely tested datasets in most generalized cases, demonstrating its superiority over current BP training methods through the use of a forward-forward (FF) training algorithm. This research illustrates a totally new ANN design paradigm, which is a significant departure from current ANN designs, potentially leading to more biologically plausible AI systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。