DExperts:解码时间控制的专家和反专家文本生成
DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts
摘要:
尽管最近在自然语言生成方面取得了进展,但控制所生成文本的属性仍然具有挑战性。我们建议D专家:解码时间专家,一种用于受控文本生成的解码时间方法,将预训练的语言模型与专家产品中的“专家”LM和/或“反专家”LM相结合。直觉上,在集合中,只有当专家认为它们可能,而反专家认为它们不太可能时,令牌才会获得高概率。我们将DExperts应用于语言解毒和情感控制生成,在自动和人工评估方面优于现有的可控生成方法。此外,由于DEvexpert仅对预训练LM的输出进行操作,因此它对较小规模的(反)专家有效,包括在GPT-3上操作时。我们的工作突出了调整小LM的文本与(联合国)理想的属性,有效的解码时间转向的承诺。
英文摘要:
Despite recent advances in natural language generation, it remains challenging to control attributes of generated text. We propose DExperts: Decoding-time Experts, a decoding-time method for controlled text generation that combines a pretrained language model with "expert" LMs and/or "anti-expert" LMs in a product of experts. Intuitively, under the ensemble, tokens only get high probability if they are considered likely by the experts, and unlikely by the anti-experts. We apply DExperts to language detoxification and sentiment-controlled generation, where we outperform existing controllable generation methods on both automatic and human evaluations. Moreover, because DExperts operates only on the output of the pretrained LM, it is effective with (anti-)experts of smaller size, including when operating on GPT-3. Our work highlights the promise of tuning small LMs on text with (un)desirable attributes for efficient decoding-time steering.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。