揭开词嵌入的梦想:走向语言驱动的图像生成
Unveiling the Dreams of Word Embeddings: Towards Language-Driven Image Generation
摘要:
我们介绍了语言驱动的图像生成,即生成图像的任务,该图像可视化了词嵌入的语义内容,例如,给定蚱蜢的词嵌入,我们生成蚱蜢的自然图像。我们实现了一个简单的方法,基于两个映射函数。第一个将词嵌入(如所产生的,例如,通过Word2VEC工具箱)并将其映射到高级视觉空间(例如,由卷积神经网络的顶层之一定义的空间)。第二个函数将这个抽象的视觉表示映射到像素空间,以生成目标图像。几个用户研究表明,目前的系统产生的图像,捕捉一般的视觉特性的概念编码的词嵌入,如颜色或典型的环境,并足以区分一般类别的对象。
英文摘要:
We introduce language-driven image generation, the task of generating an image visualizing the semantic contents of a word embedding, e.g., given the word embedding of grasshopper, we generate a natural image of a grasshopper. We implement a simple method based on two mapping functions. The first takes as input a word embedding (as produced, e.g., by the word2vec toolkit) and maps it onto a high-level visual space (e.g., the space defined by one of the top layers of a Convolutional Neural Network). The second function maps this abstract visual representation to pixel space, in order to generate the target image. Several user studies suggest that the current system produces images that capture general visual properties of the concepts encoded in the word embedding, such as color or typical environment, and are sufficient to discriminate between general categories of objects.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。