Sparse Distributed Memory is a Continual Learner
Harvard University（哈佛大学）；Harvard College（哈佛学院）；MIT-IBM Watson AI Lab（麻省理工学院-IBM沃森人工智能实验室）；IBM Research（IBM研究院）；Harvard Medical School（哈佛医学院）
英文摘要：
Continual learning is a problem for artificial neural networks that their biological counterparts are adept at solving. Building on work using Sparse Distributed Memory (SDM) to connect a core neural circuit with the powerful Transformer model, we create a modified Multi-Layered Perceptron (MLP) that is a strong continual learner. We find that every component of our MLP variant translated from biology is necessary for continual learning. Our solution is also free from any memory replay or task information, and introduces novel methods to train sparse networks that may be broadly applicable.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
