arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.07543cs.CVcs.LG
收藏

GAN记忆无遗忘

GAN Memory with No Forgetting

Duke University(杜克大学)

Yulai Cong, Miaoyun Zhao, Jianqiao Li, Sijia Wang, Lawrence Carin

摘要:

灾难性遗忘是终身学习中的一个基本问题,它是由不可获取的历史数据直接引起的,因此,如果数据(信息)被完美地记住,就不应该期望遗忘。受此启发,我们提出了一种用于终身学习的GAN存储器,它能够通过生成过程记住数据集流,并具有\emph{no}遗忘。我们的GAN记忆是基于认识到人们可以调节GAN模型的“风格”以形成感知距离的目标生成。因此,我们建议在行为良好的基础GAN模型上进行顺序样式调制,以形成顺序目标生成模型,同时受益于传输的基础知识。因此,GAN记忆--由终身学习激发--本身就表现为一种终身学习的形式,通过前向转移和调节先前任务的信息。实验表明,我们的方法优于现有的方法和它的有效性,在减轻终身分类问题的灾难性遗忘。代码可在https://github.com/MiaoyunZhao/GANmemory_LifelongLearning上获得。

英文摘要:

As a fundamental issue in lifelong learning, catastrophic forgetting is directly caused by inaccessible historical data; accordingly, if the data (information) were memorized perfectly, no forgetting should be expected. Motivated by that, we propose a GAN memory for lifelong learning, which is capable of remembering a stream of datasets via generative processes, with \emph{no} forgetting. Our GAN memory is based on recognizing that one can modulate the "style" of a GAN model to form perceptually-distant targeted generation. Accordingly, we propose to do sequential style modulations atop a well-behaved base GAN model, to form sequential targeted generative models, while simultaneously benefiting from the transferred base knowledge. The GAN memory -- that is motivated by lifelong learning -- is therefore itself manifested by a form of lifelong learning, via forward transfer and modulation of information from prior tasks. Experiments demonstrate the superiority of our method over existing approaches and its effectiveness in alleviating catastrophic forgetting for lifelong classification problems. Code is available at https://github.com/MiaoyunZhao/GANmemory_LifelongLearning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑