生物启发模块在一般学习中的作用
The Role of Bio-Inspired Modularity in General Learning
摘要:
一般智能的一个目标是在没有先验知识的情况下学习新的信息。学习而不遗忘(CF)的效用是双重的:首先,系统可以在学习新东西后返回到以前学习的任务。此外,自举先前知识可以允许更快地学习新任务。以前的CF和Bootstrapping方法主要是基于修改学习,通过改变权重的形式来调整模型以适应当前任务,而不是之前调整的权重。然而,另一个被很大程度上忽视的关键因素是初始网络拓扑或架构。在这里,我们认为,生物大脑的拓扑结构可能进化出了某些旨在实现这种信息保守的特征。特别是,我们认为模块化的高度保守性可以为权重更新学习方法提供一种解决方案,该方法坚持学习而不会出现灾难性遗忘和自举约束。最后考虑如何结合这两个学习目标的动态,一般的学习系统。
英文摘要:
One goal of general intelligence is to learn novel information without overwriting prior learning. The utility of learning without forgetting (CF) is twofold: first, the system can return to previously learned tasks after learning something new. In addition, bootstrapping previous knowledge may allow for faster learning of a novel task. Previous approaches to CF and bootstrapping are primarily based on modifying learning in the form of changing weights to tune the model to the current task, overwriting previously tuned weights from previous tasks.However, another critical factor that has been largely overlooked is the initial network topology, or architecture. Here, we argue that the topology of biological brains likely evolved certain features that are designed to achieve this kind of informational conservation. In particular, we consider that the highly conserved property of modularity may offer a solution to weight-update learning methods that adheres to the learning without catastrophic forgetting and bootstrapping constraints. Final considerations are then made on how to combine these two learning objectives in a dynamical, general learning system.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。