arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.03987cs.LGstat.ML
收藏

弱监督学习的数据一致性

Data Consistency for Weakly Supervised Learning

Department of Computer Science, Virginia Tech(弗吉尼亚理工大学计算机科学系)

Chidubem Arachie, Bert Huang

摘要:

在许多应用中,训练机器学习模型涉及使用大量人工注释的数据。为数据获取精确的标签是昂贵的。相反,监督不力的培训提供了一种低成本的替代方案。我们提出了一种新的弱监督算法,处理噪声标签,即,弱信号,同时还考虑训练数据的特征以产生用于训练的准确标签。我们的方法搜索数据表示的分类器,以找到合理的标签。我们称这种范式为数据一致性弱监督。我们的框架的一个关键方面是,我们能够估计标签的数据示例低或没有覆盖的弱监督。此外,我们对弱信号和数据的真实标签的联合分布没有任何假设。相反,我们使用弱信号和数据特征来解决约束优化问题,以确保我们生成的标签之间的数据一致性。我们的方法在不同数据集上的实证评估表明,它显着优于国家的最先进的弱监督方法的文本和图像分类任务。

英文摘要:

In many applications, training machine learning models involves using large amounts of human-annotated data. Obtaining precise labels for the data is expensive. Instead, training with weak supervision provides a low-cost alternative. We propose a novel weak supervision algorithm that processes noisy labels, i.e., weak signals, while also considering features of the training data to produce accurate labels for training. Our method searches over classifiers of the data representation to find plausible labelings. We call this paradigm data consistent weak supervision. A key facet of our framework is that we are able to estimate labels for data examples low or no coverage from the weak supervision. In addition, we make no assumptions about the joint distribution of the weak signals and true labels of the data. Instead, we use weak signals and the data features to solve a constrained optimization that enforces data consistency among the labels we generate. Empirical evaluation of our method on different datasets shows that it significantly outperforms state-of-the-art weak supervision methods on both text and image classification tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑