arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.13191cs.LG
收藏

构造参数自适应的正交随机结构网络及其数据分析

Orthogonal Stochastic Configuration Networks with Adaptive Construction Parameter for Data Analytics

China University of Mining and Technology(中国矿业大学);Northeastern University(东北大学)

Wei Dai, Chuanfeng Ning, Shiyu Pei, Song Zhu, Xuesong Wang

摘要:

作为一种随机学习模型,SCN的特点是采用监督机制来分配随机权重和偏差,以确保通用逼近和快速学习。然而,随机性使得SCN更可能产生近似线性相关的冗余和低质量的节点,从而导致非紧凑的网络结构。根据机器学习中的基本原理,即,具有较少参数的模型保持改进的泛化。本文提出了正交SCN(OSCN),通过结合Gram-Schmidt正交化技术来过滤掉低质量的隐藏节点,以实现网络结构简化。详细介绍了OSCN的普适逼近特性和关键结构参数的自适应设置。此外,一个增量式更新计划的发展,以动态地确定输出权重,有助于提高计算效率。最后,在两个数值例子和几个真实世界的回归和分类数据集上的实验结果证实了所提出的方法的有效性和可行性。

英文摘要:

As a randomized learner model, SCNs are remarkable that the random weights and biases are assigned employing a supervisory mechanism to ensure universal approximation and fast learning. However, the randomness makes SCNs more likely to generate approximate linear correlative nodes that are redundant and low quality, thereby resulting in non-compact network structure. In the light of a fundamental principle in machine learning, that is, a model with fewer parameters holds improved generalization. This paper proposes orthogonal SCN, termed OSCN, to filtrate out the low-quality hidden nodes for network structure reduction by incorporating Gram-Schmidt orthogonalization technology. The universal approximation property of OSCN and an adaptive setting for the key construction parameters have been presented in details. In addition, an incremental updating scheme is developed to dynamically determine the output weights, contributing to improved computational efficiency. Finally, experimental results on two numerical examples and several real-world regression and classification datasets substantiate the effectiveness and feasibility of the proposed approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑