arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2307.07413cs.LGcs.AIcs.CV
收藏

利用反例进行偏标签主动学习

Exploiting Counter-Examples for Active Learning with Partial labels

Shanghai Jiao Tong University(上海交通大学);Hong Kong Baptist University(香港浸会大学);Nanyang Technological University(南洋理工大学);Nanjing University of Science and Technology(南京理工大学)

Fei Zhang, Yunjie Ye, Lei Feng, Zhongwen Rao, Jieming Zhu, Marcus Kalander, Chen Gong, Jianye Hao, Bo Han

AI总结:

针对偏标签主动学习中的过拟合与代表性样本不足问题,提出通过反转偏标签构造反例并用WorseNet进行对抗性评估,显著提升十个AL框架性能。

摘要:

本文研究了一个新问题——偏标签主动学习(active learning with partial labels,ALPL)。在该设定下,预言机使用偏标签标注查询样本,从而使预言机从要求苛刻的精确标注过程中解脱出来。为解决ALPL,我们首先构建了一个直观的基线,它可以无缝集成到现有的AL框架中。尽管该基线有效,但仍容易受到过拟合的影响,并且在查询过程中缺乏具有代表性的、基于偏标签的样本。受认知科学中人类推理的启发——准确的推理可以明确地从反例(counter-examples,CEs)中得出——我们的目标是利用这种类人学习模式来缓解过拟合,同时增强ALPL中代表性样本的选择过程。具体而言,我们通过反转每个实例的偏标签来构造CEs,随后提出一个简单但有效的WorseNet,直接从这种互补模式中学习。通过利用WorseNet与预测器之间的分布差距,这种对抗性评估方式既可以提升预测器自身的性能,也可以改进样本选择过程,使预测器能够捕捉数据中更准确的模式。在五个真实世界数据集和四个基准数据集上的实验结果表明,我们提出的方法相较十个具有代表性的AL框架取得了全面提升,凸显了WorseNet的优越性。源代码将在 https://github.com/Ferenas/APLL 提供。

英文摘要:

This paper studies a new problem, \emph{active learning with partial labels} (ALPL). In this setting, an oracle annotates the query samples with partial labels, relaxing the oracle from the demanding accurate labeling process. To address ALPL, we first build an intuitive baseline that can be seamlessly incorporated into existing AL frameworks. Though effective, this baseline is still susceptible to the \emph{overfitting}, and falls short of the representative partial-label-based samples during the query process. Drawing inspiration from human inference in cognitive science, where accurate inferences can be explicitly derived from \emph{counter-examples} (CEs), our objective is to leverage this human-like learning pattern to tackle the \emph{overfitting} while enhancing the process of selecting representative samples in ALPL. Specifically, we construct CEs by reversing the partial labels for each instance, and then we propose a simple but effective WorseNet to directly learn from this complementary pattern. By leveraging the distribution gap between WorseNet and the predictor, this adversarial evaluation manner could enhance both the performance of the predictor itself and the sample selection process, allowing the predictor to capture more accurate patterns in the data. Experimental results on five real-world datasets and four benchmark datasets show that our proposed method achieves comprehensive improvements over ten representative AL frameworks, highlighting the superiority of WorseNet. The source code will be available at \url{https://github.com/Ferenas/APLL}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑