一种减轻神经文本退化的简单对比学习目标
A Simple Contrastive Learning Objective for Alleviating Neural Text Degeneration
摘要:
交叉熵目标已被证明是自回归语言模型(LM)的通用训练目标。然而,在不考虑有问题的令牌的惩罚的情况下,使用交叉熵训练的LM表现出文本退化。为了解决这个问题,已经提出了非似然训练来降低LM预测的不太可能的令牌的概率。但是不可能性不考虑标签标记和不可能标记候选者之间的关系,因此在退化方面显示出边际改善。我们提出了一种新的对比令牌学习目标,继承了交叉熵和非似然训练的优点,并避免了它们的局限性。关键思想是教LM生成标签标记的高概率和负候选的低概率。语言建模和开放域对话生成任务的综合实验表明,所提出的对比令牌目标产生更少的重复文本,具有更高的生成质量比基线方法,实现了新的国家的最先进的性能对文本退化。
英文摘要:
The cross-entropy objective has proved to be an all-purpose training objective for autoregressive language models (LMs). However, without considering the penalization of problematic tokens, LMs trained using cross-entropy exhibit text degeneration. To address this, unlikelihood training has been proposed to reduce the probability of unlikely tokens predicted by LMs. But unlikelihood does not consider the relationship between the label tokens and unlikely token candidates, thus showing marginal improvements in degeneration. We propose a new contrastive token learning objective that inherits the advantages of cross-entropy and unlikelihood training and avoids their limitations. The key idea is to teach a LM to generate high probabilities for label tokens and low probabilities of negative candidates. Comprehensive experiments on language modeling and open-domain dialogue generation tasks show that the proposed contrastive token objective yields much less repetitive texts, with a higher generation quality than baseline approaches, achieving the new state-of-the-art performance on text degeneration.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。