arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.04408cs.CLcs.AIcs.LG
收藏

使用不同数量的注释学习:从零到多个标签

Learning with Different Amounts of Annotation: From Zero to Many Labels

The University of Texas at Austin(德克萨斯大学奥斯汀分校)

Shujian Zhang, Chengyue Gong, Eunsol Choi

摘要:

训练NLP系统通常假设访问每个示例具有单个人类标签的注释数据。鉴于注释者的不完美标记和语言的固有歧义,我们假设单个标签不足以学习语言解释的频谱。我们探索新的注释分布方案,分配多个标签每个例子的一个小子集的训练样本。以标注更少的示例为代价引入这样的多标签示例在自然语言推理任务和实体分类任务上带来了明显的收益,即使当我们简单地首先用单个标签数据进行训练,然后用多标签示例进行微调时。扩展MixUp数据增强框架,我们提出了一种学习算法,可以从具有不同注释量(零个,一个或多个标签)的训练样本中学习。该算法有效地结合了来自不均匀训练数据的信号,并在低注释预算和跨域设置中带来了额外的增益。总之,我们的方法在两个任务中实现了一致的增益,这表明在训练样本之间不均匀地分布标签对许多NLP任务都是有益的。

英文摘要:

Training NLP systems typically assumes access to annotated data that has a single human label per example. Given imperfect labeling from annotators and inherent ambiguity of language, we hypothesize that single label is not sufficient to learn the spectrum of language interpretation. We explore new annotation distribution schemes, assigning multiple labels per example for a small subset of training examples. Introducing such multi label examples at the cost of annotating fewer examples brings clear gains on natural language inference task and entity typing task, even when we simply first train with a single label data and then fine tune with multi label examples. Extending a MixUp data augmentation framework, we propose a learning algorithm that can learn from training examples with different amount of annotation (with zero, one, or multiple labels). This algorithm efficiently combines signals from uneven training data and brings additional gains in low annotation budget and cross domain settings. Together, our method achieves consistent gains in two tasks, suggesting distributing labels unevenly among training examples can be beneficial for many NLP tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑