arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1109.0820cs.LGcs.AIcs.CVstat.ML
收藏

ShareBoost:具有特征共享的高效多类学习

ShareBoost: Efficient Multiclass Learning with Feature Sharing

the Hebrew University of Jerusalem(耶路撒冷希伯来大学);OrCam Ltd.(奥卡姆有限公司)

Shai Shalev-Shwartz, Yonatan Wexler, Amnon Shashua

摘要:

多类预测是将一个对象分类到一个相关的目标类的问题。我们考虑的问题,学习一个多类预测器,只使用很少的功能,特别是,使用的功能的数量应增加次线性与可能的类的数量。这意味着特性应该由几个类共享。我们描述和分析的ShareBoost算法学习多类预测,使用很少的共享功能。我们证明,ShareBoost有效地找到一个预测,使用很少的共享功能(如果这样的预测存在),它有一个小的泛化误差。我们还描述了如何使用ShareBoost来学习具有快速评估时间的非线性预测器。在一系列自然数据集的实验中,我们展示了ShareBoost的好处,并评估了它相对于其他最先进方法的成功。

英文摘要:

Multiclass prediction is the problem of classifying an object into a relevant target class. We consider the problem of learning a multiclass predictor that uses only few features, and in particular, the number of used features should increase sub-linearly with the number of possible classes. This implies that features should be shared by several classes. We describe and analyze the ShareBoost algorithm for learning a multiclass predictor that uses few shared features. We prove that ShareBoost efficiently finds a predictor that uses few shared features (if such a predictor exists) and that it has a small generalization error. We also describe how to use ShareBoost for learning a non-linear predictor that has a fast evaluation time. In a series of experiments with natural data sets we demonstrate the benefits of ShareBoost and evaluate its success relatively to other state-of-the-art approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑