一种优化神经网络结构和泛化能力的新构造方法
A New Constructive Method to Optimize Neural Network Architecture and Generalization
摘要:
本文在分析了神经网络中泛化能力差和过拟合的原因后,将某些噪声数据看作是一个连续函数的奇异值--跳跃不连续点。连续部分可以用最简单的神经网络来逼近,这种网络具有良好的泛化性能和最优的网络结构,传统的算法有增量训练前馈神经网络的构造算法、BP算法、ELM算法、各种构造算法、RBF逼近和SVM。同时,我们将构造径向基函数神经网络来拟合具有误差的奇异值,并证明了具有跳跃间断点的函数可以由具有误差的衰减径向基函数神经网络的最简单的神经网络来逼近,对于具有跳跃间断点的函数,可以用衰减RBF神经网络构造性地逼近,且构造性部分不存在泛化能力对整个机器学习系统的影响,优化神经网络结构和泛化性能,避免对噪声数据的拟合,减少过拟合现象。
英文摘要:
In this paper, after analyzing the reasons of poor generalization and overfitting in neural networks, we consider some noise data as a singular value of a continuous function - jump discontinuity point. The continuous part can be approximated with the simplest neural networks, which have good generalization performance and optimal network architecture, by traditional algorithms such as constructive algorithm for feed-forward neural networks with incremental training, BP algorithm, ELM algorithm, various constructive algorithm, RBF approximation and SVM. At the same time, we will construct RBF neural networks to fit the singular value with every error in, and we prove that a function with jumping discontinuity points can be approximated by the simplest neural networks with a decay RBF neural networks in by each error, and a function with jumping discontinuity point can be constructively approximated by a decay RBF neural networks in by each error and the constructive part have no generalization influence to the whole machine learning system which will optimize neural network architecture and generalization performance, reduce the overfitting phenomenon by avoid fitting the noisy data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。