arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1310.7048cs.LGstat.ML
收藏

通过精确数据简化缩放SVM和最小绝对偏差

Scaling SVM and Least Absolute Deviations via Exact Data Reduction

Arizona State University(亚利桑那州立大学)

Jie Wang, Peter Wonka, Jieping Ye

摘要:

支持向量机(SVM)是一种广泛使用的分类方法。虽然许多努力已经致力于开发有效的解决方案,它仍然具有挑战性的SVM应用到大规模的问题。SVM的一个很好的特性是非支持向量对分类器没有影响。受此启发,我们提出了快速,有效的筛选规则,通过分析支持向量机的对偶问题,通过变分不等式(DVI),以丢弃非支持向量。结果,可以大大减少要输入到优化中的数据实例的数量。我们的筛选方法的一些吸引人的特点是:(1)DVI是安全的,在这个意义上,DVI丢弃的向量是保证非支持向量;(2)数据集只需要扫描一次运行筛选,其计算成本是可以忽略不计相比,解决SVM问题;(3)DVI是独立的求解器,可以集成到任何现有的有效的解决方案。我们还表明,DVI技术可以扩展到检测非支持向量的最小绝对偏差回归(LAD)。据我们所知,目前还没有LAD的筛查方法。我们已经评估了DVI的合成和真实的数据集。实验表明,DVI明显优于现有的最先进的SVM筛选规则,是非常有效的,在丢弃非支持向量的LAD。通过DVI规则获得的加速比可以达到两个数量级。

英文摘要:

The support vector machine (SVM) is a widely used method for classification. Although many efforts have been devoted to develop efficient solvers, it remains challenging to apply SVM to large-scale problems. A nice property of SVM is that the non-support vectors have no effect on the resulting classifier. Motivated by this observation, we present fast and efficient screening rules to discard non-support vectors by analyzing the dual problem of SVM via variational inequalities (DVI). As a result, the number of data instances to be entered into the optimization can be substantially reduced. Some appealing features of our screening method are: (1) DVI is safe in the sense that the vectors discarded by DVI are guaranteed to be non-support vectors; (2) the data set needs to be scanned only once to run the screening, whose computational cost is negligible compared to that of solving the SVM problem; (3) DVI is independent of the solvers and can be integrated with any existing efficient solvers. We also show that the DVI technique can be extended to detect non-support vectors in the least absolute deviations regression (LAD). To the best of our knowledge, there are currently no screening methods for LAD. We have evaluated DVI on both synthetic and real data sets. Experiments indicate that DVI significantly outperforms the existing state-of-the-art screening rules for SVM, and is very effective in discarding non-support vectors for LAD. The speedup gained by DVI rules can be up to two orders of magnitude.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑