arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1406.4676stat.ME
收藏

基于序贯设计和不确定性抽样的主动学习

Active Learning Via Sequential Design and Uncertainty Sampling

Jing Wang, Eunsik Park, Yuan-chin Ivan Chang

摘要:

分类是生物医学研究和机器学习等许多领域的重要任务。传统上,分类规则是基于一堆标记数据构建的。近年来,由于技术创新和自动数据收集方案,我们很容易遇到包含大量未标记样本的数据集。由于对每一个数据进行标记的代价很高且效率很低,因此如何利用这些未标记的数据进行分类器的构造就成为一个重要的问题。在机器学习文献中,主动学习或半监督学习是在这种情况下讨论的流行概念,其中分类算法基于从其学习过程的前一阶段学习到的信息顺序地招募新的未标记的主题,然后这些新的主题被标记并作为新的训练样本被包括在内。从统计学的角度来看,这些方法可以被认为是序贯设计和随机逼近过程的混合。在本文中,我们研究了顺序学习过程中建立高效和有效的分类器,其中只有选定的主题被标记,并包括在其学习阶段。该算法结合了贝叶斯序贯优化设计和不确定性抽样的思想。算法的计算问题进行了讨论。使用合成的数据和真实的例子的数值结果报告。

英文摘要:

Classification is an important task in many fields including biomedical research and machine learning. Traditionally, a classification rule is constructed based a bunch of labeled data. Recently, due to technological innovation and automatic data collection schemes, we easily encounter with data sets containing large amounts of unlabeled samples. Because to label each of them is usually costly and inefficient, how to utilize these unlabeled data in a classifier construction process becomes an important problem. In machine learning literature, active learning or semi-supervised learning are popular concepts discussed under this situation, where classification algorithms recruit new unlabeled subjects sequentially based on the information learned from previous stages of its learning process, and these new subjects are then labeled and included as new training samples. From a statistical aspect, these methods can be recognized as a hybrid of the sequential design and stochastic approximation procedure. In this paper, we study sequential learning procedures for building efficient and effective classifiers, where only the selected subjects are labeled and included in its learning stage. The proposed algorithm combines the ideas of Bayesian sequential optimal design and uncertainty sampling. Computational issues of the algorithm are discussed. Numerical results using both synthesized data and real examples are reported.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑