混合链路网络
Mixed Link Networks
摘要:
通过揭示现代网络的等价性进行分析,我们发现ResNet和DenseNet本质上都来自相同的“密集拓扑”,但它们只是在连接形式上有所不同-添加(称为“内部链接”)与连接(称为“外部链接”)。然而,这两种形式的联系都有其优越性和不足。为了结合它们的优点并避免表示学习的某些限制,我们提出了一种高效的模块化混合链接网络(MixNet),它配备了灵活的内部链接和外部链接模块。因此,ResNet,DenseNet和DPN可以分别被视为MixNet的特殊情况。此外,我们证明了MixNets可以在许多竞争数据集(如CIFAR-10/100,SVHN和ImageNet)上实现优于最先进架构的参数效率。
英文摘要:
Basing on the analysis by revealing the equivalence of modern networks, we find that both ResNet and DenseNet are essentially derived from the same "dense topology", yet they only differ in the form of connection -- addition (dubbed "inner link") vs. concatenation (dubbed "outer link"). However, both two forms of connections have the superiority and insufficiency. To combine their advantages and avoid certain limitations on representation learning, we present a highly efficient and modularized Mixed Link Network (MixNet) which is equipped with flexible inner link and outer link modules. Consequently, ResNet, DenseNet and Dual Path Network (DPN) can be regarded as a special case of MixNet, respectively. Furthermore, we demonstrate that MixNets can achieve superior efficiency in parameter over the state-of-the-art architectures on many competitive datasets like CIFAR-10/100, SVHN and ImageNet.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。