信息瓶颈元学习的分解可塑性规则演化
Evolving Decomposed Plasticity Rules for Information-Bottlenecked Meta-Learning
摘要:
人工神经网络(ANN)通常被限制为通过学习一组静态参数来完成预定义的任务。相比之下,生物神经网络(BNN)可以通过基于输入不断更新神经连接来适应各种新任务,这与除了静态参数之外还学习有效学习规则的范例一致,例如,元学习在各种生物启发的学习规则中,赫布可塑性使用局部信号更新神经网络权重,而无需明确的目标函数的指导,从而使智能体能够自动学习而无需人工努力。然而,使用大量元参数的典型塑性ANN违反了基因组学瓶颈的性质,并可能恶化泛化能力。这项工作提出了一种新的学习范式,这些连接依赖的可塑性规则分解成依赖于神经元的规则,从而容纳$Θ(n^2)$可学习的参数,只有$Θ(n)$元参数。我们还深入研究了不同的神经调制对可塑性的影响。我们的算法在具有挑战性的随机2D迷宫环境中进行了测试,在这种环境中,智能体必须使用他们过去的经验来塑造神经连接并提高他们未来的性能。实验结果验证了以下几点:1.可塑性可以用来不断更新随机初始化的RNN,以超越预先训练的、更复杂的递归模型,特别是在长期记忆方面。2.在基因组学瓶颈之后,所提出的分解可塑性在某些情况下可以与典型可塑性规则相当甚至更有效。
英文摘要:
Artificial neural networks (ANNs) are typically confined to accomplishing pre-defined tasks by learning a set of static parameters. In contrast, biological neural networks (BNNs) can adapt to various new tasks by continually updating the neural connections based on the inputs, which is aligned with the paradigm of learning effective learning rules in addition to static parameters, e.g., meta-learning. Among various biologically inspired learning rules, Hebbian plasticity updates the neural network weights using local signals without the guide of an explicit target function, thus enabling an agent to learn automatically without human efforts. However, typical plastic ANNs using a large amount of meta-parameters violate the nature of the genomics bottleneck and potentially deteriorate the generalization capacity. This work proposes a new learning paradigm decomposing those connection-dependent plasticity rules into neuron-dependent rules thus accommodating $Θ(n^2)$ learnable parameters with only $Θ(n)$ meta-parameters. We also thoroughly study the effect of different neural modulation on plasticity. Our algorithms are tested in challenging random 2D maze environments, where the agents have to use their past experiences to shape the neural connections and improve their performances for the future. The results of our experiment validate the following: 1. Plasticity can be adopted to continually update a randomly initialized RNN to surpass pre-trained, more sophisticated recurrent models, especially when coming to long-term memorization. 2. Following the genomics bottleneck, the proposed decomposed plasticity can be comparable to or even more effective than canonical plasticity rules in some instances.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。