arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1406.2889cs.NE
收藏

极限学习机中输入权值的显式计算

Explicit Computation of Input Weights in Extreme Learning Machines

Jonathan Tapson, Philip de Chazal, André van Schaik

摘要:

本文给出了一个封闭形式的多层感知器输入权值初始化表达式,它可以作为极限学习机综合的第一步。该表达式基于在多层感知器和线性支持向量机中计算的分离超平面的标准函数;即,作为输入数据样本的线性组合。在没有对输入权重进行监督训练的情况下,使用训练数据样本的随机线性组合来将输入数据投影到更高维的隐藏层。隐藏层权重以标准ELM方式通过计算隐藏层输出的伪逆并乘以期望的输出值来求解。这种方法的所有权重都可以在一次计算中计算出来,并且在一些标准问题上,所得到的网络比相同大小的常规ELM网络更准确,更一致。

英文摘要:

We present a closed form expression for initializing the input weights in a multi-layer perceptron, which can be used as the first step in synthesis of an Extreme Learning Ma-chine. The expression is based on the standard function for a separating hyperplane as computed in multilayer perceptrons and linear Support Vector Machines; that is, as a linear combination of input data samples. In the absence of supervised training for the input weights, random linear combinations of training data samples are used to project the input data to a higher dimensional hidden layer. The hidden layer weights are solved in the standard ELM fashion by computing the pseudoinverse of the hidden layer outputs and multiplying by the desired output values. All weights for this method can be computed in a single pass, and the resulting networks are more accurate and more consistent on some standard problems than regular ELM networks of the same size.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑