arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1906.09443cs.LGcs.AIstat.ML
收藏

一种具有稳定学习规则的基于增强KNN的孪生支持向量机

An enhanced KNN-based twin support vector machine with stable learning rules

Islamic Azad University(伊斯兰阿扎德大学);Iranian Research Institute for Information Science and Technology (IranDoc)(伊朗信息科学与技术研究所(IranDoc))

A. Mir, Jalal A. Nasiri

摘要:

在双支持向量机(TSVM)的扩展中,有学者利用K-近邻(KNN)图来提高TSVM的分类精度。然而,这些基于KNN的TSVM分类器有两个主要问题,如高计算成本和过拟合。为了解决这些问题,本文提出了一种增强的正则化K-最近邻的孪生支持向量机(RKNN-TSVM)。它有三个额外的优点:(1)通过考虑与其最近邻的距离来给每个样本加权。这进一步降低了噪声和离群值对输出模型的影响。(2)在每个目标函数中增加了一个稳定项。结果表明,该方法的学习规则是稳定的。(3)为了减少为所有样本寻找KNN的计算量,将基于多距离的位置差k-近邻算法(LDMDBA)嵌入到该方法的学习过程中。在几个合成数据集和基准数据集上的实验结果表明,我们提出的RKNN-TSVM在分类精度和计算时间上都是有效的。此外,在所提出的方法中,最大的加速比达到14倍。

英文摘要:

Among the extensions of twin support vector machine (TSVM), some scholars have utilized K-nearest neighbor (KNN) graph to enhance TSVM's classification accuracy. However, these KNN-based TSVM classifiers have two major issues such as high computational cost and overfitting. In order to address these issues, this paper presents an enhanced regularized K-nearest neighbor based twin support vector machine (RKNN-TSVM). It has three additional advantages: (1) Weight is given to each sample by considering the distance from its nearest neighbors. This further reduces the effect of noise and outliers on the output model. (2) An extra stabilizer term was added to each objective function. As a result, the learning rules of the proposed method are stable. (3) To reduce the computational cost of finding KNNs for all the samples, location difference of multiple distances based k-nearest neighbors algorithm (LDMDBA) was embedded into the learning process of the proposed method. The extensive experimental results on several synthetic and benchmark datasets show the effectiveness of our proposed RKNN-TSVM in both classification accuracy and computational time. Moreover, the largest speedup in the proposed method reaches to 14 times.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑