arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0212030cs.LGcs.CV
收藏

基于实例学习中交叉验证误差和投票的理论分析

Theoretical Analyses of Cross-Validation Error and Voting in Instance-Based Learning

Peter D. Turney

摘要:

本文从监督学习算法的交叉验证测试中的误差的一般理论开始,从例子中。假设这些例子是由属性-值对描述的,其中的值是符号的。交叉验证需要一组训练样本和一组测试样本。要预测的属性的值在训练集中对学习器是已知的,但在测试集中是未知的。该理论表明,交叉验证误差有两个组成部分:训练集上的误差(不准确)和对噪声的敏感性(不稳定)。然后将这一一般理论应用于基于实例的学习中的投票。给定测试集中的一个示例,典型的基于实例的学习算法通过在训练集中与测试示例最近的k个近邻(k个最相似的示例)中投票来预测指定的属性。投票的目的是增加基于实例的学习的稳定性(抗噪声),但理论分析表明,在某些情况下,投票可能会不稳定。该理论提出了通过确保投票稳定且不会对准确性产生不利影响来最小化交叉验证错误的方法。

英文摘要:

This paper begins with a general theory of error in cross-validation testing of algorithms for supervised learning from examples. It is assumed that the examples are described by attribute-value pairs, where the values are symbolic. Cross-validation requires a set of training examples and a set of testing examples. The value of the attribute that is to be predicted is known to the learner in the training set, but unknown in the testing set. The theory demonstrates that cross-validation error has two components: error on the training set (inaccuracy) and sensitivity to noise (instability). This general theory is then applied to voting in instance-based learning. Given an example in the testing set, a typical instance-based learning algorithm predicts the designated attribute by voting among the k nearest neighbors (the k most similar examples) to the testing example in the training set. Voting is intended to increase the stability (resistance to noise) of instance-based learning, but a theoretical analysis shows that there are circumstances in which voting can be destabilizing. The theory suggests ways to minimize cross-validation error, by insuring that voting is stable and does not adversely affect accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑