arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1806.01935cs.CV
收藏

探索DenseNet体系结构中的特征重用

Exploring Feature Reuse in DenseNet Architectures

University of Alberta(阿尔伯塔大学)

Andy Hess

摘要:

密集连接卷积网络(DenseNets)已被证明可以在图像分类任务上实现最先进的结果,同时使用比竞争方法更少的参数和计算。由于该架构中的每一层都可以完全访问所有先前层的特征图,因此网络不必重新学习先前有用的特征,从而减轻了梯度消失的问题。在这项工作中,我们探讨的问题:在何种程度上是必要的连接到所有以前的层,以获得功能重用的好处?为此,我们引入了本地密集连接的概念,并提出证据表明,较少的连接,允许在一个固定的网络容量增加增长率,可以实现更有效地重用功能,并导致更高的准确性在密集的架构。

英文摘要:

Densely Connected Convolutional Networks (DenseNets) have been shown to achieve state-of-the-art results on image classification tasks while using fewer parameters and computation than competing methods. Since each layer in this architecture has full access to the feature maps of all previous layers, the network is freed from the burden of having to relearn previously useful features, thus alleviating issues with vanishing gradients. In this work we explore the question: To what extent is it necessary to connect to all previous layers in order to reap the benefits of feature reuse? To this end, we introduce the notion of local dense connectivity and present evidence that less connectivity, allowing for increased growth rate at a fixed network capacity, can achieve a more efficient reuse of features and lead to higher accuracy in dense architectures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑