arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1701.02265stat.MLmath.STstat.COstat.TH
收藏

论多类分类中的选择与细化

On Reject and Refine Options in Multicategory Classification

Chong Zhang, Wenbo Wang, Xingye Qiao

摘要:

在统计学习的许多实际应用中,由于误分类而做出的决策可能代价太高;在这种情况下,拒绝选项(将决策推迟到进行进一步调查)通常是首选。近年来,带有拒绝选项的二进制分类有了很大的发展。然而,在多类别案件方面进展甚微。在这篇文章中,我们提出了基于边缘的多类别分类方法与拒绝选项。此外,更重要的是,我们为多类别问题引入了一个新的独特的细化选项,其中观察的类别被预测为来自一组类别标签,其基数不一定是1。这两个选项的主要优点在于它们能够识别容易出错的观测结果。此外,细化选项可以通过有效地排除不可信的类来为分类提供更具建设性的信息。已经开发了有效的实施所提出的方法。在理论方面,我们提供了一种新的统计学习理论,并显示出快速收敛速度的过剩$\ell$ -风险,我们的方法,重点是分散的维度和数量的类。在低噪声假设下,结果可以进一步改善。一组全面的模拟和真实数据的研究表明,新的学习工具相比,定期多类别分类器的有用性。详细的证明定理和扩展的数值结果包括在补充材料在线提供。

英文摘要:

In many real applications of statistical learning, a decision made from misclassification can be too costly to afford; in this case, a reject option, which defers the decision until further investigation is conducted, is often preferred. In recent years, there has been much development for binary classification with a reject option. Yet, little progress has been made for the multicategory case. In this article, we propose margin-based multicategory classification methods with a reject option. In addition, and more importantly, we introduce a new and unique refine option for the multicategory problem, where the class of an observation is predicted to be from a set of class labels, whose cardinality is not necessarily one. The main advantage of both options lies in their capacity of identifying error-prone observations. Moreover, the refine option can provide more constructive information for classification by effectively ruling out implausible classes. Efficient implementations have been developed for the proposed methods. On the theoretical side, we offer a novel statistical learning theory and show a fast convergence rate of the excess $\ell$-risk of our methods with emphasis on diverging dimensionality and number of classes. The results can be further improved under a low noise assumption. A set of comprehensive simulation and real data studies has shown the usefulness of the new learning tools compared to regular multicategory classifiers. Detailed proofs of theorems and extended numerical results are included in the supplemental materials available online.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑