网络移植(扩展摘要)
Network Transplanting (extended abstract)
摘要:
本文着重于一个新的任务,即,将类别和任务特定的神经网络移植到通用的模块化网络,而无需强有力的监督。我们设计了一个通用网络的功能可解释的结构。就像构建乐高积木一样,我们通过直接移植与预训练网络中的类别相对应的模块来教授通用网络一个新的类别,该类别具有一些甚至没有样本注释。我们的方法逐步增加新的类别的通用网络,但不影响现有类别的表示。通过这种方式,我们的方法打破了为大量任务和类别学习网络的典型瓶颈,即,在学习开始之前同时收集所有任务和类别的样本的要求。因此,我们使用一种新的蒸馏算法,即回蒸馏,以克服网络移植的具体挑战。我们没有训练样本的方法甚至超过了100个训练样本的基线。
英文摘要:
This paper focuses on a new task, i.e., transplanting a category-and-task-specific neural network to a generic, modular network without strong supervision. We design a functionally interpretable structure for the generic network. Like building LEGO blocks, we teach the generic network a new category by directly transplanting the module corresponding to the category from a pre-trained network with a few or even without sample annotations. Our method incrementally adds new categories to the generic network but does not affect representations of existing categories. In this way, our method breaks the typical bottleneck of learning a net for massive tasks and categories, i.e., the requirement of collecting samples for all tasks and categories at the same time before the learning begins. Thus, we use a new distillation algorithm, namely back-distillation, to overcome specific challenges of network transplanting. Our method without training samples even outperformed the baseline with 100 training samples.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。