arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.12911cs.LG
收藏

实例相关部分标记学习

Instance-Dependent Partial Label Learning

Southeast University(东南大学)

Ning Xu, Congyu Qiao, Xin Geng, Min-Ling Zhang

摘要:

部分标签学习(PLL)是一个典型的弱监督学习问题,其中每个训练样本与一组候选标签相关联,其中只有一个标签是真的。大多数现有的PLL方法假设每个训练样本中的不正确标签被随机挑选为候选标签。然而,这种假设是不现实的,因为候选标签总是依赖于实例的。在本文中,我们考虑依赖于实例的PLL,并假设每个例子是与一个潜在的标签分布构成的每个标签的实数,代表的程度,每个标签描述的功能。具有高程度的不正确标签更有可能被注释为候选标签。因此,潜在标签分布是部分标记示例中的基本标记信息,值得用于预测模型训练。出于这种考虑,我们提出了一种新的PLL方法,该方法将标签分布恢复为标签增强(LE)过程,并在每个时期迭代地训练预测模型。具体来说,我们假设真正的后验密度的潜在标签分布的变分近似Dirichlet密度参数化的推理模型。然后推导出优化推理模型的证据下界,并利用变分后验概率生成的标签分布来训练预测模型。在基准数据集和真实数据集上的实验验证了该方法的有效性。源代码可在https://github.com/palm-ml/valen上获得。

英文摘要:

Partial label learning (PLL) is a typical weakly supervised learning problem, where each training example is associated with a set of candidate labels among which only one is true. Most existing PLL approaches assume that the incorrect labels in each training example are randomly picked as the candidate labels. However, this assumption is not realistic since the candidate labels are always instance-dependent. In this paper, we consider instance-dependent PLL and assume that each example is associated with a latent label distribution constituted by the real number of each label, representing the degree to each label describing the feature. The incorrect label with a high degree is more likely to be annotated as the candidate label. Therefore, the latent label distribution is the essential labeling information in partially labeled examples and worth being leveraged for predictive model training. Motivated by this consideration, we propose a novel PLL method that recovers the label distribution as a label enhancement (LE) process and trains the predictive model iteratively in every epoch. Specifically, we assume the true posterior density of the latent label distribution takes on the variational approximate Dirichlet density parameterized by an inference model. Then the evidence lower bound is deduced for optimizing the inference model and the label distributions generated from the variational posterior are utilized for training the predictive model. Experiments on benchmark and real-world datasets validate the effectiveness of the proposed method. Source code is available at https://github.com/palm-ml/valen.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑