arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1607.00567stat.MLcs.LG
收藏

Rademacher Complexity Bounds for a Penalized Multiclass Semi-Supervised Algorithm

Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室);Univ. Grenoble Alpes(格勒诺布尔-阿尔卑斯大学);CNRS(法国国家科学研究中心);Grenoble INP(格勒诺布尔理工学院);University of Washington(华盛顿大学)

Yury Maximov, Massih-Reza Amini, Zaid Harchaoui

英文摘要:

We propose Rademacher complexity bounds for multiclass classifiers trained with a two-step semi-supervised model. In the first step, the algorithm partitions the partially labeled data and then identifies dense clusters containing $κ$ predominant classes using the labeled training examples such that the proportion of their non-predominant classes is below a fixed threshold. In the second step, a classifier is trained by minimizing a margin empirical loss over the labeled training set and a penalization term measuring the disability of the learner to predict the $κ$ predominant classes of the identified clusters. The resulting data-dependent generalization error bound involves the margin distribution of the classifier, the stability of the clustering technique used in the first step and Rademacher complexity terms corresponding to partially labeled training data. Our theoretical result exhibit convergence rates extending those proposed in the literature for the binary case, and experimental results on different multiclass classification problems show empirical evidence that supports the theory.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑