InstantStyle-Plus：文本到图像生成中保持内容的风格迁移
InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generation
AI总结：
本文提出InstantStyle-Plus，通过解构风格迁移为风格、空间结构和语义内容三要素，结合内容潜在噪声初始化、tile ControlNet和全局语义适配器，在保持原图内容完整性的同时实现高效风格注入。
摘要：
风格迁移是一种创造性过程，旨在创建一幅既保持原图本质又融入另一视觉风格的图像。尽管扩散模型在个性化主体驱动或风格驱动应用中展现出令人印象深刻的生成能力，现有最先进方法在内容保持与风格增强之间实现无缝平衡方面仍面临困难。例如，增强风格影响力往往会破坏内容的结构完整性。为应对这些挑战，我们将风格迁移任务解构为三个核心要素：1）风格，关注图像的美学特征；2）空间结构，涉及视觉元素的几何排列与构图；3）语义内容，捕捉图像的概念含义。基于这些原则，我们提出InstantStyle-Plus，一种在无缝融入目标风格的同时优先保持原始内容完整性的方法。具体而言，我们的方法利用前沿的InstantStyle框架，通过高效、轻量的过程实现风格注入。为强化内容保持，我们以反转后的内容潜在噪声作为初始化，并采用通用的即插即用tile ControlNet来保留原始图像的内在布局。我们还引入全局语义适配器以增强语义内容的保真度。为防止风格信息被稀释，采用风格提取器作为判别器提供补充风格引导。代码将发布于https://github.com/instantX-research/InstantStyle-Plus。
英文摘要：
Style transfer is an inventive process designed to create an image that maintains the essence of the original while embracing the visual style of another. Although diffusion models have demonstrated impressive generative power in personalized subject-driven or style-driven applications, existing state-of-the-art methods still encounter difficulties in achieving a seamless balance between content preservation and style enhancement. For example, amplifying the style's influence can often undermine the structural integrity of the content. To address these challenges, we deconstruct the style transfer task into three core elements: 1) Style, focusing on the image's aesthetic characteristics; 2) Spatial Structure, concerning the geometric arrangement and composition of visual elements; and 3) Semantic Content, which captures the conceptual meaning of the image. Guided by these principles, we introduce InstantStyle-Plus, an approach that prioritizes the integrity of the original content while seamlessly integrating the target style. Specifically, our method accomplishes style injection through an efficient, lightweight process, utilizing the cutting-edge InstantStyle framework. To reinforce the content preservation, we initiate the process with an inverted content latent noise and a versatile plug-and-play tile ControlNet for preserving the original image's intrinsic layout. We also incorporate a global semantic adapter to enhance the semantic content's fidelity. To safeguard against the dilution of style information, a style extractor is employed as discriminator for providing supplementary style guidance. Codes will be available at https://github.com/instantX-research/InstantStyle-Plus.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
