arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.01352cs.LG
收藏

利用钟形曲线权重函数改进不确定性采样

Improving Uncertainty Sampling with Bell Curve Weight Function

Kwansei Gakuin University(关西学院大学);Universiti Tunku Abdul Rahman(拉曼大学)

Zan-Kai Chong, Hiroyuki Ohsaki, Bok-Min Goi

AI总结:

针对不确定性采样易受 AUR 与数据集性质影响的问题,提出以 p=0.5 为中心的钟形曲线权重采样,在优先选择不确定实例的同时兼顾其他样本,并在多类数据集上取得更优表现。

摘要:

通常,监督学习模型通过被动学习进行训练,即随机选择未标注实例进行标注。这种方法对于学习模型是有效的,但在获取标注实例成本高昂的情况下可能代价很大。例如,在初始数据收集期间,从涌入收件箱的数千封电子邮件(未标注实例)中手动识别垃圾邮件(标注实例)可能非常耗时。一般而言,我们用不确定性采样来应对上述场景,这是一种主动学习方法,通过使用比被动学习更少的标注实例来提高监督学习的效率。给定一个未标注数据池,不确定性采样会查询预测概率 p 落入不确定区域(即 $p \approx 0.5$)的实例的标签。然后,新获得的标签会被添加到现有标注数据池中,以学习新模型。尽管如此,不确定性采样的性能容易受到不可预测响应区域(AUR)和数据集性质的影响。在没有关于新数据集的先验知识的情况下,很难决定应使用被动学习还是不确定性采样。为解决这一问题,我们提出了钟形曲线采样,该方法采用钟形曲线权重函数来获取新标签。钟形曲线以 p=0.5 为中心,因此钟形曲线采样在大多数时候会选择预测值处于不确定区域的实例,同时不会忽略其余实例。仿真结果表明,在具有不同性质且包含 AUR 的数据集上,钟形曲线采样在大多数时候都优于不确定性采样和被动学习。

英文摘要:

Typically, a supervised learning model is trained using passive learning by randomly selecting unlabelled instances to annotate. This approach is effective for learning a model, but can be costly in cases where acquiring labelled instances is expensive. For example, it can be time-consuming to manually identify spam mails (labelled instances) from thousands of emails (unlabelled instances) flooding an inbox during initial data collection. Generally, we answer the above scenario with uncertainty sampling, an active learning method that improves the efficiency of supervised learning by using fewer labelled instances than passive learning. Given an unlabelled data pool, uncertainty sampling queries the labels of instances where the predicted probabilities, p, fall into the uncertainty region, i.e., $p \approx 0.5$. The newly acquired labels are then added to the existing labelled data pool to learn a new model. Nonetheless, the performance of uncertainty sampling is susceptible to the area of unpredictable responses (AUR) and the nature of the dataset. It is difficult to determine whether to use passive learning or uncertainty sampling without prior knowledge of a new dataset. To address this issue, we propose bell curve sampling, which employs a bell curve weight function to acquire new labels. With the bell curve centred at p=0.5, bell curve sampling selects instances whose predicted values are in the uncertainty area most of the time without neglecting the rest. Simulation results show that, most of the time bell curve sampling outperforms uncertainty sampling and passive learning in datasets of different natures and with AUR.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑