基于几何变换的kNN和支持向量机的非线性度量学习
Nonlinear Metric Learning for kNN and SVMs through Geometric Transformations
摘要:
近年来,将线性度量学习模型扩展到处理非线性结构的研究引起了人们极大的兴趣。在本文中,我们提出了一种新的非线性解决方案,通过利用可变形几何模型来学习空间变化的度量,并应用该策略来提高kNN和SVM分类器的性能。薄板样条(TPS)被选为几何模型,由于其显着的通用性和代表性的权力,在占高阶变形。通过TPS对输入空间进行变换,我们可以在kNN中将同类邻居拉得更近,同时将不同类的点推得更远,并使支持向量机中的输入数据点更具线性可分性。kNN分类性能的改进通过在合成和真实世界数据集上的实验来证明,并与几种最先进的度量学习解决方案进行了比较。我们基于SVM的模型也实现了显着的改进,传统的线性和内核SVM相同的数据集。
英文摘要:
In recent years, research efforts to extend linear metric learning models to handle nonlinear structures have attracted great interests. In this paper, we propose a novel nonlinear solution through the utilization of deformable geometric models to learn spatially varying metrics, and apply the strategy to boost the performance of both kNN and SVM classifiers. Thin-plate splines (TPS) are chosen as the geometric model due to their remarkable versatility and representation power in accounting for high-order deformations. By transforming the input space through TPS, we can pull same-class neighbors closer while pushing different-class points farther away in kNN, as well as make the input data points more linearly separable in SVMs. Improvements in the performance of kNN classification are demonstrated through experiments on synthetic and real world datasets, with comparisons made with several state-of-the-art metric learning solutions. Our SVM-based models also achieve significant improvements over traditional linear and kernel SVMs with the same datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。