arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2305.14551cs.CVcs.LG

通过矩阵分解探索 GAN 潜在空间中的语义变化

Exploring Semantic Variations in GAN Latent Spaces via Matrix Factorization

Innopolis University(Innopolis大学);University of Hull(赫尔大学)

Andrey Palaev, Rustam A. Lukmanov, Adil Khan

AI总结:

本文通过矩阵分解探索GAN潜在空间的语义变化,发现GANSpace方法虽能生成高质量图像操作但存在高度纠缠,用ICA替换PCA可提升操作质量与分离度,且GAN规模影响图像质量但不改变基本控制方向的存在。

摘要:

使用 GAN 进行受控数据生成是理想的,但由于其潜在空间的非线性和高维性而极具挑战。在这项工作中,我们探索了由 GANSpace(一种基于 PCA 的最先进方法)学习的图像操作。通过定量和定性评估,我们表明:(a) GANSpace 可产生广泛的高质量图像操作,但它们可能高度纠缠,限制了潜在的用例;(b) 用 ICA 替换 PCA 可提高操作的质量和分离度;(c) 生成图像的质量可能对 GAN 的规模敏感,但无论其复杂度如何,在其潜在空间中都可以观察到基本的控制方向。

英文摘要:

Controlled data generation with GANs is desirable but challenging due to the nonlinearity and high dimensionality of their latent spaces. In this work, we explore image manipulations learned by GANSpace, a state-of-the-art method based on PCA. Through quantitative and qualitative assessments we show: (a) GANSpace produces a wide range of high-quality image manipulations, but they can be highly entangled, limiting potential use cases; (b) Replacing PCA with ICA improves the quality and disentanglement of manipulations; (c) The quality of the generated images can be sensitive to the size of GANs, but regardless of their complexity, fundamental controlling directions can be observed in their latent spaces.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑