在文本生成中控制关键字及其位置
Controlling keywords and their positions in text generation
摘要:
文本生成中的挑战之一是按照用户的意图控制文本生成。以前的研究建议指定应包含在生成的文本中的关键字。然而,这种方法不足以生成反映用户意图的文本。例如,在文本的开头放置一个重要的关键字将有助于吸引读者的注意力;然而,现有的方法不能实现这种灵活的控制。在本文中,我们解决了一个新的任务,不仅控制关键字,而且每个关键字在文本生成的位置。为此,我们提出了一个独立于任务的方法,使用特殊的令牌来控制关键字的相对位置。摘要和故事生成任务的实验结果表明,该方法可以控制关键字及其位置。实验结果还表明,控制关键字位置可以生成比基线更接近用户意图的摘要文本。
英文摘要:
One of the challenges in text generation is to control text generation as intended by the user. Previous studies proposed specifying the keywords that should be included in the generated text. However, this approach is insufficient to generate text that reflect the user's intent. For example, placing an important keyword at the beginning of the text would help attract the reader's attention; however, existing methods do not enable such flexible control. In this paper, we tackle a novel task of controlling not only keywords but also the position of each keyword in the text generation. To this end, we propose a task-independent method that uses special tokens to control the relative position of keywords. Experimental results on summarization and story generation tasks show that the proposed method can control keywords and their positions. The experimental results also demonstrate that controlling the keyword positions can generate summary texts that are closer to the user's intent than baseline.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。