arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0906.1814cs.LGcs.AI
收藏

使用深度编码器网络的大间隔kNN分类

Large-Margin kNN Classification Using a Deep Encoder Network

University of Toronto(多伦多大学)

Martin Renqiang Min, David A. Stanley, Zineng Yuan, Anthony Bonner, Zhaolei Zhang

摘要:

KNN是最流行的分类方法之一,但由于距离度量的选择不当或存在大量与类别无关的特征,它通常无法很好地工作。线性特征变换方法已被广泛应用于提取类相关信息以改进kNN分类,但在许多应用中非常有限。核函数已被用于学习强大的非线性特征变换,但这些方法无法扩展到大型数据集。在本文中,我们提出了一种可扩展的非线性特征映射方法,该方法基于用限制性玻尔兹曼机预训练的深度神经网络,用于在大间隔框架中改进kNN分类,我们称之为DNet-kNN。DNet-kNN可用于分类和监督降维。在两个基准手写数字数据集上的实验结果表明,DNet-kNN比使用线性映射的大间隔kNN和基于用限制玻尔兹曼机预训练的深度自动编码器的kNN具有更好的性能。

英文摘要:

KNN is one of the most popular classification methods, but it often fails to work well with inappropriate choice of distance metric or due to the presence of numerous class-irrelevant features. Linear feature transformation methods have been widely applied to extract class-relevant information to improve kNN classification, which is very limited in many applications. Kernels have been used to learn powerful non-linear feature transformations, but these methods fail to scale to large datasets. In this paper, we present a scalable non-linear feature mapping method based on a deep neural network pretrained with restricted boltzmann machines for improving kNN classification in a large-margin framework, which we call DNet-kNN. DNet-kNN can be used for both classification and for supervised dimensionality reduction. The experimental results on two benchmark handwritten digit datasets show that DNet-kNN has much better performance than large-margin kNN using a linear mapping and kNN based on a deep autoencoder pretrained with retricted boltzmann machines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑