SwapAnything：在个性化视觉编辑中实现任意对象交换
SwapAnything: Enabling Arbitrary Object Swapping in Personalized Visual Editing
AI总结：
本文提出 SwapAnything 框架，通过定向变量交换和外观适配，在保持上下文不变的前提下实现图像中任意对象、部件及跨域对象的个性化精确交换，并在多类任务上显著优于基线方法。
摘要：
对个人内容进行有效编辑在帮助个体表达创造力、在其视觉故事中编织引人入胜的叙事以及提升视觉内容的整体质量与影响力方面发挥着关键作用。因此，在本工作中，我们提出了 SwapAnything，这是一个新颖的框架，能够在保持上下文不变的情况下，将图像中的任意对象替换为参考图所给出的个性化概念。与现有的个性化主体交换方法相比，SwapAnything 具有三个独特优势：（1）能够精确控制任意对象和局部部件，而不仅仅是主要主体；（2）更忠实地保留上下文像素；（3）使个性化概念更好地适配目标图像。首先，我们提出了 targeted variable swapping（定向变量交换），在潜在特征图上施加区域控制，并交换被掩码的变量，以实现忠实的上下文保留和初始语义概念交换。然后，我们引入了 appearance adaptation（外观适配），在图像生成过程中，使语义概念在目标位置、形状、风格和内容方面无缝地适配到原始图像中。在人工评估和自动评估上的大量结果表明，我们的方法在个性化交换任务上相比基线方法取得了显著改进。此外，SwapAnything 在单对象、多对象、部分对象以及跨域交换任务中均展现出精确且忠实的交换能力。SwapAnything 在基于文本的交换以及对象插入等交换之外的任务上也取得了优异性能。
英文摘要：
Effective editing of personal content holds a pivotal role in enabling individuals to express their creativity, weaving captivating narratives within their visual stories, and elevate the overall quality and impact of their visual content. Therefore, in this work, we introduce SwapAnything, a novel framework that can swap any objects in an image with personalized concepts given by the reference, while keeping the context unchanged. Compared with existing methods for personalized subject swapping, SwapAnything has three unique advantages: (1) precise control of arbitrary objects and parts rather than the main subject, (2) more faithful preservation of context pixels, (3) better adaptation of the personalized concept to the image. First, we propose targeted variable swapping to apply region control over latent feature maps and swap masked variables for faithful context preservation and initial semantic concept swapping. Then, we introduce appearance adaptation, to seamlessly adapt the semantic concept into the original image in terms of target location, shape, style, and content during the image generation process. Extensive results on both human and automatic evaluation demonstrate significant improvements of our approach over baseline methods on personalized swapping. Furthermore, SwapAnything shows its precise and faithful swapping abilities across single object, multiple objects, partial object, and cross-domain swapping tasks. SwapAnything also achieves great performance on text-based swapping and tasks beyond swapping such as object insertion.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
