arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1405.1445cs.NE
收藏

隐层参数拉回误差技术:无输出权的单隐层前馈网络

Pulling back error to the hidden-node parameter technology: Single-hidden-layer feedforward network without output weight

Yimin Yang, Q. M. Jonathan Wu, Guangbin Huang, Yaonan Wang

摘要:

根据传统的神经网络理论,单隐层前馈神经网络(SLFN)的特征依赖于加权连接和隐节点的参数。当网络的参数包括隐节点参数和输出权值至少存在时,SLFN是通用逼近器。与上述神经网络理论不同,本文指出,为了使SLFN具有通用逼近器的功能,只需计算隐节点参数,而不需要输出权值。换句话说,所提出的神经网络架构可以被认为是具有等于单位向量的固定输出权重的标准SLFN。此外,本文提出的实验表明,所提出的学习方法倾向于极大地减少网络输出误差到一个非常小的数字,只有1个隐藏节点。仿真结果表明,该方法可以提供几到几千倍的速度比其他学习算法,包括BP,SVM/SVR和其他ELM方法。

英文摘要:

According to conventional neural network theories, the feature of single-hidden-layer feedforward neural networks(SLFNs) resorts to parameters of the weighted connections and hidden nodes. SLFNs are universal approximators when at least the parameters of the networks including hidden-node parameter and output weight are exist. Unlike above neural network theories, this paper indicates that in order to let SLFNs work as universal approximators, one may simply calculate the hidden node parameter only and the output weight is not needed at all. In other words, this proposed neural network architecture can be considered as a standard SLFNs with fixing output weight equal to an unit vector. Further more, this paper presents experiments which show that the proposed learning method tends to extremely reduce network output error to a very small number with only 1 hidden node. Simulation results demonstrate that the proposed method can provide several to thousands of times faster than other learning algorithm including BP, SVM/SVR and other ELM methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑