arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.04750cs.CV
收藏

电子商务中基于条件与掩码引导的免训练风格一致图像合成

Training-Free Style Consistent Image Synthesis with Condition and Mask Guidance in E-Commerce

Suning(苏宁)

Guandong Li

AI总结:

针对电商风格一致图像生成,本文提出免训练方法,通过 QKV 层级修改、共享 KV 与注意力图掩码引导,在保持商品构图的同时提升风格一致性。

摘要:

生成风格一致的图像是电子商务领域的常见任务,当前方法大多基于扩散模型,并已取得优异效果。本文介绍了 QKV(query/key/value,查询/键/值)层级的概念,指在将 UNet 与图像条件结合时对注意力图(自注意力和交叉注意力)进行修改。在不破坏电子商务图像中商品主体构图的前提下,我们旨在采用由预设条件引导的免训练方法。该方法包括使用共享 KV 增强交叉注意力中的相似性,并根据注意力图生成掩码引导,以巧妙地指导风格一致图像的生成。我们的方法在实际应用中展现出良好效果。

英文摘要:

Generating style-consistent images is a common task in the e-commerce field, and current methods are largely based on diffusion models, which have achieved excellent results. This paper introduces the concept of the QKV (query/key/value) level, referring to modifications in the attention maps (self-attention and cross-attention) when integrating UNet with image conditions. Without disrupting the product's main composition in e-commerce images, we aim to use a train-free method guided by pre-set conditions. This involves using shared KV to enhance similarity in cross-attention and generating mask guidance from the attention map to cleverly direct the generation of style-consistent images. Our method has shown promising results in practical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑