arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.04114cs.CLcs.AIcs.LG
收藏

生成和修改:神经诗歌中的强化学习

Generate and Revise: Reinforcement Learning in Neural Poetry

University of Florence(佛罗伦萨大学);University of Siena(锡耶纳大学)

Andrea Zugarini, Luca Pasqualini, Stefano Melacci, Marco Maggini

摘要:

作家、诗人、歌唱家通常不会一口气创作出他们的作品。为了更好地传达作者想要表达的意义、情感和感受,文本被重新审视、调整、修改、重新措辞,甚至多次。在高贵的书面艺术中,诗歌可能是最需要精心制作的艺术,因为它必须正式尊重预定义的韵律和押韵方案。在本文中,我们提出了一个框架,以产生诗歌,反复重温和纠正,因为人类做的,以提高他们的整体质量。我们在强化学习的背景下,特别是使用近端策略优化来构建修改诗歌的问题。我们的模型从头开始生成诗歌,并学习逐步调整生成的文本以匹配目标标准。我们评估这种方法的情况下,匹配的押韵方案,没有任何信息的话负责创建押韵,以及如何连贯地改变诗歌的话。建议的框架是通用的,并与适当的奖励塑造,它可以应用到其他文本生成问题。

英文摘要:

Writers, poets, singers usually do not create their compositions in just one breath. Text is revisited, adjusted, modified, rephrased, even multiple times, in order to better convey meanings, emotions and feelings that the author wants to express. Amongst the noble written arts, Poetry is probably the one that needs to be elaborated the most, since the composition has to formally respect predefined meter and rhyming schemes. In this paper, we propose a framework to generate poems that are repeatedly revisited and corrected, as humans do, in order to improve their overall quality. We frame the problem of revising poems in the context of Reinforcement Learning and, in particular, using Proximal Policy Optimization. Our model generates poems from scratch and it learns to progressively adjust the generated text in order to match a target criterion. We evaluate this approach in the case of matching a rhyming scheme, without having any information on which words are responsible of creating rhymes and on how to coherently alter the poem words. The proposed framework is general and, with an appropriate reward shaping, it can be applied to other text generation problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑