arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1911.03385cs.CL
收藏

用于风格转换和内容保存的低级语言控制

Low-Level Linguistic Controls for Style Transfer and Content Preservation

Columbia University(哥伦比亚大学)

Katy Gero, Chris Kedzie, Jonathan Reeve, Lydia Chilton

摘要:

尽管风格转移在图像处理中取得了成功,但在自然语言生成中的进展有限。部分问题在于文本域中的内容不容易与样式分离。奇怪的是,在文体计量学领域,内容在区分文体元素(如作者身份和体裁)的实际方法中并不突出。而句法和虚词是最突出的特征。在这项工作的基础上,我们将风格建模为一套低层次的语言控制,如代词,介词和从句结构的频率。我们训练一个神经编码器-解码器模型来重建参考句子,只给出内容词和控件的设置。我们通过保持内容词固定,同时调整控件以指示另一种风格来执行风格转换。在实验中,我们表明,该模型可靠地响应语言控制,并进行自动和手动评估的风格转移。我们发现我们可以在84%的时间里欺骗风格分类器,并且我们的模型产生了高度多样化和风格独特的输出。这项工作介绍了一个正式的,可扩展的风格模型,可以添加控制任何神经文本生成系统。

英文摘要:

Despite the success of style transfer in image processing, it has seen limited progress in natural language generation. Part of the problem is that content is not as easily decoupled from style in the text domain. Curiously, in the field of stylometry, content does not figure prominently in practical methods of discriminating stylistic elements, such as authorship and genre. Rather, syntax and function words are the most salient features. Drawing on this work, we model style as a suite of low-level linguistic controls, such as frequency of pronouns, prepositions, and subordinate clause constructions. We train a neural encoder-decoder model to reconstruct reference sentences given only content words and the setting of the controls. We perform style transfer by keeping the content words fixed while adjusting the controls to be indicative of another style. In experiments, we show that the model reliably responds to the linguistic controls and perform both automatic and manual evaluations on style transfer. We find we can fool a style classifier 84% of the time, and that our model produces highly diverse and stylistically distinctive outputs. This work introduces a formal, extendable model of style that can add control to any neural text generation system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑