VOLTA: Improving Generative Diversity by Variational Mutual Information Maximizing Autoencoder
VOLTA:通过变分互信息最大化自编码器提升生成多样性
机构 * The Chinese University of Hong Kong(香港中文大学) ; Huawei Noah’s Ark Lab(华为诺亚方舟实验室)
AI总结 本文提出VOLTA框架,通过交叉注意力连接Transformer与VAE,并引入InfoGAN风格潜码,在保持生成质量的同时显著提升自然语言生成的多样性。
Comments 15 pages. Published in Findings of the Association for Computational Linguistics: NAACL 2024
Journal ref Findings of the Association for Computational Linguistics: NAACL 2024, pages 364-378