功能产品产生高效网络
Feature Products Yield Efficient Networks
摘要:
我们介绍了基于生物视觉原理启发的新构建块的新型深度网络架构--产品网络(FP-nets)。对于每个输入特征图,所谓的FP块学习两个不同的滤波器,然后将其输出相乘。这种FP-块的灵感来自于末端停止神经元的模型,这在皮层区域V1,特别是V2中很常见。通过用FP-块代替常规的正则卷积块,可以将卷积神经网络转化为参数有效的FP-网。通过这种方式,我们基于最先进的网络创建了几个新的FP网络,并在Cifar-10和ImageNet挑战中对其进行了评估。我们表明,使用FP-块的参数的数量显着减少,而不降低泛化能力。由于到目前为止,算法和搜索算法已经被用来寻找更有效的网络,因此我们可以根据一种新的生物启发设计原理获得更有效的网络,这似乎是值得注意的。
英文摘要:
We introduce Feature-Product networks (FP-nets) as a novel deep-network architecture based on a new building block inspired by principles of biological vision. For each input feature map, a so-called FP-block learns two different filters, the outputs of which are then multiplied. Such FP-blocks are inspired by models of end-stopped neurons, which are common in cortical areas V1 and especially in V2. Convolutional neural networks can be transformed into parameter-efficient FP-nets by substituting conventional blocks of regular convolutions with FP-blocks. In this way, we create several novel FP-nets based on state-of-the-art networks and evaluate them on the Cifar-10 and ImageNet challenges. We show that the use of FP-blocks reduces the number of parameters significantly without decreasing generalization capability. Since so far heuristics and search algorithms have been used to find more efficient networks, it seems remarkable that we can obtain even more efficient networks based on a novel bio-inspired design principle.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。