基于神经注意模型的中文歌曲抑扬格生成
Chinese Song Iambics Generation with Neural Attention-based Model
摘要:
汉语诗歌的学习和创作是一项富有魅力而又富有挑战性的任务。传统的方法涉及各种语言建模和机器翻译技术,然而,它们在生成具有复杂模式约束的诗歌时表现不佳,例如宋词,一种涉及可变长度句子和严格节奏模式的着名诗歌类型。本文将基于注意力的序列到序列模型应用于中文歌曲抑扬格的生成。具体来说,我们通过双向长短期记忆(LSTM)模型对线索句进行编码,然后用编码器提供的信息预测整个抑扬格,以基于注意力的LSTM的形式,可以通过输入线索的精细结构来规范生成过程。研究了几种改进模型的技术,包括全局上下文集成、混合风格训练、特征向量初始化和自适应。自动和主观评价的结果表明,我们的模型确实可以学习复杂的结构和节奏模式的歌曲抑扬格,生成是相当成功的。
英文摘要:
Learning and generating Chinese poems is a charming yet challenging task. Traditional approaches involve various language modeling and machine translation techniques, however, they perform not as well when generating poems with complex pattern constraints, for example Song iambics, a famous type of poems that involve variable-length sentences and strict rhythmic patterns. This paper applies the attention-based sequence-to-sequence model to generate Chinese Song iambics. Specifically, we encode the cue sentences by a bi-directional Long-Short Term Memory (LSTM) model and then predict the entire iambic with the information provided by the encoder, in the form of an attention-based LSTM that can regularize the generation process by the fine structure of the input cues. Several techniques are investigated to improve the model, including global context integration, hybrid style training, character vector initialization and adaptation. Both the automatic and subjective evaluation results show that our model indeed can learn the complex structural and rhythmic patterns of Song iambics, and the generation is rather successful.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。