arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.08616cs.AI
收藏

用于序列生成的条件混合GAN

Conditional Hybrid GAN for Sequence Generation

National Institute of Informatics(国立信息学研究所);MIDAS, IIIT-Delhi(德里因陀罗普拉萨信息技术学院 MIDAS 实验室)

Yi Yu, Abhishek Srivastava, Rajiv Ratn Shah

摘要:

条件序列生成的目的是通过用附加的上下文信息调节模型来指导生成过程,这是一个自监督学习问题(一种具有来自数据本身的监督信息的无监督学习形式)。不幸的是,目前的国家的最先进的生成模型具有多属性的序列生成的局限性。在本文中,我们提出了一种新的条件混合GAN(C-Hybrid-GAN)来解决这个问题。当以相同的上下文为条件时,分别生成具有三元组属性的离散序列。最重要的是,利用关系推理技术,不仅在生成器的训练过程中建模每个属性序列内部的依赖性,而且在训练过程中建模属性序列之间的一致性。为了避免GANs在离散数据生成过程中遇到的不可微性问题,我们利用Gumbel-Softmax技术来近似离散值序列的分布,通过评估从歌词生成旋律(与音符、持续时间和休止符相关联)的任务,我们证明了所提出的C-Hybrid-GAN在上下文条件下的离散值序列生成方面优于现有方法。

英文摘要:

Conditional sequence generation aims to instruct the generation procedure by conditioning the model with additional context information, which is a self-supervised learning issue (a form of unsupervised learning with supervision information from data itself). Unfortunately, the current state-of-the-art generative models have limitations in sequence generation with multiple attributes. In this paper, we propose a novel conditional hybrid GAN (C-Hybrid-GAN) to solve this issue. Discrete sequence with triplet attributes are separately generated when conditioned on the same context. Most importantly, relational reasoning technique is exploited to model not only the dependency inside each sequence of the attribute during the training of the generator but also the consistency among the sequences of attributes during the training of the discriminator. To avoid the non-differentiability problem in GANs encountered during discrete data generation, we exploit the Gumbel-Softmax technique to approximate the distribution of discrete-valued sequences.Through evaluating the task of generating melody (associated with note, duration, and rest) from lyrics, we demonstrate that the proposed C-Hybrid-GAN outperforms the existing methods in context-conditioned discrete-valued sequence generation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑