arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2407.11514cs.CV

ColorwAI:通过GAN与扩散解耦生成纺织品配色方案

ColorwAI: Generative Colorways of Textiles through GAN and Diffusion Disentanglement

Institute for Digital Visual Studies, University of Zurich(苏黎世大学数字视觉研究所);Tilburg University(蒂尔堡大学)

Ludovica Schaerf, Andrea Alfarano, Eric Postma

AI总结:

本研究提出生成式纺织品配色创建任务与ColorwAI框架,结合ShapleyVec解耦方法在GAN和扩散模型上实现色彩解耦,验证StyleGAN的W空间更贴合人类色彩认知,构建创意配色系统并通过专家评估验证有效性。

摘要:

配色方案创建是指生成具有不同色彩变体、同时保留底层图案的纺织品样本的任务。为一款配色方案确定合适的调色板是一项复杂的创意任务,需要契合客户与市场需求、风格与文化规范以及情绪基调。我们对该任务进行了调整,提出“生成式配色方案”创建任务,其中包含最小程度的形状修改,并提出了名为“ColorwAI”的框架,通过在StyleGAN和扩散模型上进行色彩解耦来解决这一任务。我们提出了一种用于监督式解耦的InterfaceGAN变体方法——ShapleyVec,利用Shapley值从检测到的潜在方向中筛选出少量维度。此外,我们提出了一个通用框架,可将常见的解耦方法应用于任何具有语义潜在空间的架构,并在扩散模型和GAN上进行了测试。我们解读了模型潜在空间内的色彩表征,发现StyleGAN的W空间与人类的色彩概念最为契合。最后,我们表明解耦能够构建一个用于配色方案创建的创意系统,并通过专家问卷和创意理论对其进行了评估。

英文摘要:

Colorway creation is the task of generating textile samples in alternate color variations maintaining an underlying pattern. The individuation of a suitable color palette for a colorway is a complex creative task, responding to client and market needs, stylistic and cultural specifications, and mood. We introduce a modification of this task, the "generative colorway" creation, that includes minimal shape modifications, and propose a framework, "ColorwAI", to tackle this task using color disentanglement on StyleGAN and Diffusion. We introduce a variation of the InterfaceGAN method for supervised disentanglement, ShapleyVec. We use Shapley values to subselect a few dimensions of the detected latent direction. Moreover, we introduce a general framework to adopt common disentanglement methods on any architecture with a semantic latent space and test it on Diffusion and GANs. We interpret the color representations within the models' latent space. We find StyleGAN's W space to be the most aligned with human notions of color. Finally, we suggest that disentanglement can solicit a creative system for colorway creation, and evaluate it through expert questionnaires and creativity theory.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑