LatentGandr: 通过局部嵌入进行生成AI潜在空间的可视化探索
LatentGandr: Visual Exploration of Generative AI Latent Space via Local Embeddings
AI总结:
本文提出LatentGandr,通过提取高维潜在空间中的局部线性维度,实现生成AI潜在空间的可视化探索,提升用户交互体验。
摘要:
生成AI在创意设计中展现出巨大潜力,能够快速生成视觉内容和想象概念。尽管深度AI模型在潜在空间中实现了有效的特征化,但导航该空间仍是一个挑战。当前技术如GANSlider和SliderSpace使用多个滑块生成高维向量,但随着控制维度增加,扩展性和可用性受限。本文介绍LatentGandr,一种通过从高维潜在空间嵌入中提取局部线性维度来促进潜在空间探索的可视化分析技术。通过分析嵌入的拓扑和局部曲率,LatentGandr自动识别局部邻域并使用局部PCA计算其主成分。这些局部主成分被可视化为交互式图像网格,使用户能够高效探索和控制生成过程,提供直观的方法来精调新内容和概念的生成。为了评估LatentGandr的有效性,我们进行了一项研究,将其与GANSlider进行比较,后者是当前最先进的生成AI模型可视化接口。结果提供了关于如何通过局部探索技术增强用户与这些模型交互的见解。
英文摘要:
Generative AI has demonstrated significant potential in creative design, enabling the rapid generation of visual content and imaginative concepts. Although deep AI models achieve effective featurization in the latent space, navigating the space remains a challenge. Current techniques, such as GANSlider and SliderSpace, use multiple sliders to generate high-dimensional vectors in generative AI's latent space. Despite applying (global) PCA to reduce the number of sliders, these approaches struggle with scalability and usability as the number of control dimensions increases. In this paper, we introduce LatentGandr, a visual analytics technique that facilitates latent space exploration by extracting locally linear dimensions from embeddings in high-dimensional latent spaces. By analyzing the topology and local curvature of the embeddings, LatentGandr automatically identifies local neighborhoods and computes their principal components using localized PCA. These local principal components are visualized as interactive image grids, allowing users to efficiently explore and control the generative process, providing an intuitive means to refine the generation of novel content and concepts. To evaluate the effectiveness of LatentGandr, we conducted a study comparing it to GANSlider, the current state-of-the-art visualization interface for generative AI models. The results offer insights into how localized exploration techniques can enhance user interaction with these models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。