CoARF:用于辐射场的可控 3D 艺术风格迁移
CoARF: Controllable 3D Artistic Style Transfer for Radiance Fields
AI总结:
本文提出 CoARF 算法,通过分割掩码与标签相关损失函数实现指定对象、组合式及语义感知的可控 3D 场景风格迁移,并引入语义感知最近邻匹配算法提升迁移质量。
摘要:
创建艺术 3D 场景可能非常耗时,并且需要专业知识。为了解决这一问题,最近的一些工作(如 ARF)采用基于辐射场的方法并结合风格约束,来生成类似于用户提供的风格图像的 3D 场景。然而,这些方法缺乏对生成场景的细粒度控制。在本文中,我们引入了 Controllable Artistic Radiance Fields (CoARF)(可控艺术辐射场),这是一种用于可控 3D 场景风格化的新算法。CoARF 支持对指定对象进行风格迁移、组合式 3D 风格迁移以及语义感知的风格迁移。我们通过使用分割掩码结合不同的标签相关损失函数来实现可控性。我们还提出了一种语义感知的最近邻匹配算法,以提高风格迁移质量。我们的大量实验表明,CoARF 提供了用户指定的风格迁移可控性,并通过更精确的特征匹配实现了卓越的风格迁移质量。
英文摘要:
Creating artistic 3D scenes can be time-consuming and requires specialized knowledge. To address this, recent works such as ARF, use a radiance field-based approach with style constraints to generate 3D scenes that resemble a style image provided by the user. However, these methods lack fine-grained control over the resulting scenes. In this paper, we introduce Controllable Artistic Radiance Fields (CoARF), a novel algorithm for controllable 3D scene stylization. CoARF enables style transfer for specified objects, compositional 3D style transfer and semantic-aware style transfer. We achieve controllability using segmentation masks with different label-dependent loss functions. We also propose a semantic-aware nearest neighbor matching algorithm to improve the style transfer quality. Our extensive experiments demonstrate that CoARF provides user-specified controllability of style transfer and superior style transfer quality with more precise feature matching.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。