MS-CustomNet:基于层次关系语义的可控多主体定制
MS-CustomNet: Controllable Multi-Subject Customization with Hierarchical Relational Semantics
AI总结:
本文提出MS-CustomNet,通过层次关系语义实现多主体定制,支持零样本整合多个用户提供的对象,并允许用户显式定义主体间的层级安排与空间位置,提升多主体图像生成的精细控制能力。
摘要:
基于扩散模型的文本到图像生成已取得显著进展,但如何在保持细粒度控制主体间交互的同时实现多不同主体场景定制仍具挑战性。现有方法难以提供用户定义的构图结构和主体间精确的空间关系控制。为此,我们引入MS-CustomNet,一种新型多主体定制框架。MS-CustomNet允许零样本整合多个用户提供的对象,并关键地使用户能够显式定义生成图像中这些层级安排和空间位置。我们的方法在学习和执行用户指定的主体间组合时确保个体主体身份的保持。我们还提出了MSI数据集,源自COCO,以促进对复杂多主体组合的训练。MS-CustomNet提供增强的多主体图像生成细粒度控制。我们的方法在多主体定制任务中实现了0.61的DINO-I分数(身份保持)和0.94的YOLO-L分数(位置控制),证明其在生成高保真图像和精确用户引导的多主体组合与空间控制方面具有优越能力。
英文摘要:
Diffusion-based text-to-image generation has advanced significantly, yet customizing scenes with multiple distinct subjects while maintaining fine-grained control over their interactions remains challenging. Existing methods often struggle to provide explicit user-defined control over the compositional structure and precise spatial relationships between subjects. To address this, we introduce MS-CustomNet, a novel framework for multi-subject customization. MS-CustomNet allows zero-shot integration of multiple user-provided objects and, crucially, empowers users to explicitly define these hierarchical arrangements and spatial placements within the generated image. Our approach ensures individual subject identity preservation while learning and enacting these user-specified inter-subject compositions. We also present the MSI dataset, derived from COCO, to facilitate training on such complex multi-subject compositions. MS-CustomNet offers enhanced, fine-grained control over multi-subject image generation. Our method achieves a DINO-I score of 0.61 for identity preservation and a YOLO-L score of 0.94 for positional control in multi-subject customization tasks, demonstrating its superior capability in generating high-fidelity images with precise, user-directed multi-subject compositions and spatial control.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。