arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1909.03585cs.LGstat.ML
收藏

Learning to Sample:一个主动学习框架

Learning to Sample: an Active Learning Framework

Australian National University(澳大利亚国立大学)

Jingyu Shao, Qing Wang, Fangbing Liu

摘要:

主动学习的元学习算法正在成为学习“最佳”主动学习策略的一个有前途的范例。然而,目前基于学习的主动学习方法仍然需要足够的训练数据,以便推广用于主动学习的元学习模型。这与主动学习的本质相反,主动学习通常从少量的标记样本开始。无法获得大量标记样本来训练元学习模型将不可避免地导致性能低下(例如,不稳定性和过拟合)。在我们的论文中,我们提出了一种新的基于学习的主动学习框架,称为学习样本(LTS)来解决这些问题。该框架有两个关键组件:采样模型和提升模型,它们可以在迭代中相互学习,以提高彼此的性能。在此框架内,抽样模型将不确定性抽样和多样性抽样纳入一个统一的优化过程,使我们能够根据不确定性和多样性的优化整合,积极选择最具代表性和信息量的样本。为了评估LTS框架的有效性,我们对三个不同的分类任务进行了广泛的实验:图像分类、工资水平预测和实体解析。实验结果表明,当标签预算有限时,我们的LTS框架显着优于所有基线,特别是对于具有高度不平衡类的数据集。此外,我们的LTS框架可以有效地解决冷启动问题发生在许多现有的主动学习方法。

英文摘要:

Meta-learning algorithms for active learning are emerging as a promising paradigm for learning the ``best'' active learning strategy. However, current learning-based active learning approaches still require sufficient training data so as to generalize meta-learning models for active learning. This is contrary to the nature of active learning which typically starts with a small number of labeled samples. The unavailability of large amounts of labeled samples for training meta-learning models would inevitably lead to poor performance (e.g., instabilities and overfitting). In our paper, we tackle these issues by proposing a novel learning-based active learning framework, called Learning To Sample (LTS). This framework has two key components: a sampling model and a boosting model, which can mutually learn from each other in iterations to improve the performance of each other. Within this framework, the sampling model incorporates uncertainty sampling and diversity sampling into a unified process for optimization, enabling us to actively select the most representative and informative samples based on an optimized integration of uncertainty and diversity. To evaluate the effectiveness of the LTS framework, we have conducted extensive experiments on three different classification tasks: image classification, salary level prediction, and entity resolution. The experimental results show that our LTS framework significantly outperforms all the baselines when the label budget is limited, especially for datasets with highly imbalanced classes. In addition to this, our LTS framework can effectively tackle the cold start problem occurring in many existing active learning approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑