arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.02208cs.LGstat.ML
收藏

鲁棒单类核谱回归

Robust One-Class Kernel Spectral Regression

Bilkent university(比尔肯特大学);university of Surrey(萨里大学)

Shervin Rahimzadeh Arashloo, Josef Kittler

摘要:

核零空间技术及其基于回归的公式(称为一类核谱回归,a.k.a. OC-KSR)是一种有效的、计算上有吸引力的一类分类框架。尽管其出色的性能,核零空间方法的适用性是有限的,由于其敏感性可能的训练数据腐败和无法排名的训练观察,根据其符合模型。这项工作解决了这些缺点,通过研究的零空间核Fisher方法的解决方案的背景下,其回归为基础的配方(OC-KSR)正规化的效果。在这方面,首先,吉洪诺夫正则化在希尔伯特空间中的影响进行了分析,其中一类学习问题中存在的污染的训练集作为一个敏感性分析问题。接下来,驱动的稀疏表示方法的成功,稀疏正则化的解决方案的效果进行了研究。对于这两种替代正则化方案,提出了迭代算法,该算法递归地更新标签置信度并根据它们与模型的拟合对训练观测值进行排名。通过在不同的数据集上进行广泛的实验,发现所提出的方法与基线核零空间技术以及其他现有的方法相比,在一类分类范例中,提高了对训练集中污染的鲁棒性,同时提供了有效地对训练样本进行排名的功能。

英文摘要:

The kernel null-space technique and its regression-based formulation (called one-class kernel spectral regression, a.k.a. OC-KSR) is known to be an effective and computationally attractive one-class classification framework. Despite its outstanding performance, the applicability of kernel null-space method is limited due to its susceptibility to possible training data corruptions and inability to rank training observations according to their conformity with the model. This work addresses these shortcomings by studying the effect of regularising the solution of the null-space kernel Fisher methodology in the context of its regression-based formulation (OC-KSR). In this respect, first, the effect of a Tikhonov regularisation in the Hilbert space is analysed where the one-class learning problem in presence of contaminations in the training set is posed as a sensitivity analysis problem. Next, driven by the success of the sparse representation methodology, the effect of a sparsity regularisation on the solution is studied. For both alternative regularisation schemes, iterative algorithms are proposed which recursively update label confidences and rank training observations based on their fit with the model. Through extensive experiments conducted on different data sets, the proposed methodology is found to enhance robustness against contamination in the training set as compared with the baseline kernel null-space technique as well as other existing approaches in a one-class classification paradigm while providing the functionality to rank training samples effectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑