arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2308.12452cs.CVcs.GR

ARF-Plus:控制艺术辐射场中的感知因素以实现3D场景风格化

ARF-Plus: Controlling Perceptual Factors in Artistic Radiance Fields for 3D Scene Stylization

University of Cambridge(剑桥大学)

Wenzhao Li, Tianhao Wu, Fangcheng Zhong, Cengiz Oztireli

AI总结:

ARF-Plus提出一个3D神经风格迁移框架,通过四种感知控制(颜色、尺度、空间、深度)增强辐射场风格化的可控性,实验验证其有效性,支持多风格融合。

摘要:

辐射场风格迁移是一个新兴领域,近年来因神经辐射场在3D重建和视图合成中的出色表现,作为3D场景风格化的一种手段而广受欢迎。我们基于2D图像风格迁移中已有的概念,指出辐射场风格迁移中存在的研究空白——缺乏足够的感知可控性。在本文中,我们提出了ARF-Plus,一个提供对感知因素可管理控制的3D神经风格迁移框架,以系统探索3D场景风格化中的感知可控性。我们提出并整合了四种不同类型的控制——颜色保持控制、(风格图案)尺度控制、空间(选择性风格化区域)控制以及深度增强控制——到该框架中。来自真实世界数据集的定量和定性结果表明,我们的ARF-Plus框架中的四种控制类型在风格化3D场景时成功实现了相应的感知控制。这些技术既适用于单个风格输入,也适用于场景内同时应用多种风格的情况。这开启了无限可能性的领域,允许对风格化效果进行定制修改,并灵活融合不同风格的优势,最终能够在3D场景上创造新颖且引人注目的风格化效果。

英文摘要:

The radiance fields style transfer is an emerging field that has recently gained popularity as a means of 3D scene stylization, thanks to the outstanding performance of neural radiance fields in 3D reconstruction and view synthesis. We highlight a research gap in radiance fields style transfer, the lack of sufficient perceptual controllability, motivated by the existing concept in the 2D image style transfer. In this paper, we present ARF-Plus, a 3D neural style transfer framework offering manageable control over perceptual factors, to systematically explore the perceptual controllability in 3D scene stylization. Four distinct types of controls - color preservation control, (style pattern) scale control, spatial (selective stylization area) control, and depth enhancement control - are proposed and integrated into this framework. Results from real-world datasets, both quantitative and qualitative, show that the four types of controls in our ARF-Plus framework successfully accomplish their corresponding perceptual controls when stylizing 3D scenes. These techniques work well for individual style inputs as well as for the simultaneous application of multiple styles within a scene. This unlocks a realm of limitless possibilities, allowing customized modifications of stylization effects and flexible merging of the strengths of different styles, ultimately enabling the creation of novel and eye-catching stylistic effects on 3D scenes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑