arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0405024cs.AI
收藏

元学习进化人工神经网络

Meta-Learning Evolutionary Artificial Neural Networks

Ajith Abraham

摘要:

在本文中,我们提出了MLEANN(元学习进化人工神经网络),人工神经网络的自适应优化,其中的神经网络架构,激活函数,连接权重,学习算法及其参数的自动计算框架适应根据问题。我们探讨了MLEANN和传统设计的人工神经网络的函数逼近问题的性能。为了评估比较性能,我们使用了三个不同的著名的混沌时间序列。本文还介绍了目前流行的神经网络学习算法,并给出了一些与收敛速度和泛化性能有关的实验结果。研究了反向传播算法、共轭梯度算法、拟牛顿算法和Levenberg-Marquardt算法对三种混沌时间序列的性能。当激活函数和结构改变时,不同的学习算法的性能进行了评估。我们进一步提出的理论背景,算法,设计策略,并进一步证明如何有效的和必然的建议MLEANN框架设计的神经网络,这是更小,更快,更好的泛化性能。

英文摘要:

In this paper, we present MLEANN (Meta-Learning Evolutionary Artificial Neural Network), an automatic computational framework for the adaptive optimization of artificial neural networks wherein the neural network architecture, activation function, connection weights; learning algorithm and its parameters are adapted according to the problem. We explored the performance of MLEANN and conventionally designed artificial neural networks for function approximation problems. To evaluate the comparative performance, we used three different well-known chaotic time series. We also present the state of the art popular neural network learning algorithms and some experimentation results related to convergence speed and generalization performance. We explored the performance of backpropagation algorithm; conjugate gradient algorithm, quasi-Newton algorithm and Levenberg-Marquardt algorithm for the three chaotic time series. Performances of the different learning algorithms were evaluated when the activation functions and architecture were changed. We further present the theoretical background, algorithm, design strategy and further demonstrate how effective and inevitable is the proposed MLEANN framework to design a neural network, which is smaller, faster and with a better generalization performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑