arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1310.8243cs.LGstat.ML
收藏

准主动学习

Para-active learning

Microsoft Research(微软研究院)

Alekh Agarwal, Leon Bottou, Miroslav Dudik, John Langford

摘要:

训练样本并不是所有的信息都是一样的。主动学习策略利用这一观察结果,以大量减少需要标记的示例数量。我们利用相同的观察,建立一个通用的策略并行学习算法。这种策略是有效的,因为搜索信息丰富的例子是高度并行化的,因为我们表明,它的性能不会恶化时,筛选过程依赖于一个稍微过时的模型。并行主动学习对于训练具有非线性表示的非线性模型特别有吸引力,因为对于此类模型几乎没有实用的并行学习算法。我们报告的初步实验,使用内核支持向量机和SGD训练的神经网络。

英文摘要:

Training examples are not all equally informative. Active learning strategies leverage this observation in order to massively reduce the number of examples that need to be labeled. We leverage the same observation to build a generic strategy for parallelizing learning algorithms. This strategy is effective because the search for informative examples is highly parallelizable and because we show that its performance does not deteriorate when the sifting process relies on a slightly outdated model. Parallel active learning is particularly attractive to train nonlinear models with non-linear representations because there are few practical parallel learning algorithms for such models. We report preliminary experiments using both kernel SVMs and SGD-trained neural networks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑