arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1803.05006cs.NE
收藏

异质网络中不同神经元的条件激活

Conditional Activation for Diverse Neurons in Heterogeneous Networks

Albert Lee, Bonnie Lam, Wenyuan Li, Hochul Lee, Wei-Hao Chen, Meng-Fan Chang, Kang. -L. Wang

摘要:

在本文中,我们提出了一个新的计划,模拟神经元的不同行为。我们引入了条件激活,其中神经元激活函数被控制信号动态地修改。我们应用这种方法来重建存在于人类听觉和视觉系统中的特殊神经元的行为。一个异构的多层感知器(MLP),将开发的模型表明同时提高学习速度和性能在不同数量的隐藏单元和层,相比,一个均匀的网络组成的传统的神经元模型。对于类似的性能,所提出的模型降低了存储网络参数的内存显着。

英文摘要:

In this paper, we propose a new scheme for modelling the diverse behavior of neurons. We introduce the conditional activation, in which a neurons activation function is dynamically modified by a control signal. We apply this method to recreate behavior of special neurons existing in the human auditory and visual system. A heterogeneous multilayered perceptron (MLP) incorporating the developed models demonstrates simultaneous improvement in learning speed and performance across a various number of hidden units and layers, compared to a homogeneous network composed of the conventional neuron model. For similar performance, the proposed model lowers the memory for storing network parameters significantly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑