Style4D-Bench:用于4D风格化的基准测试套件
Style4D-Bench: A Benchmark Suite for 4D Stylization
AI总结:
Style4D-Bench是首个4D风格化基准套件,提出Style4D框架基于4D高斯泼溅,通过风格高斯表示和几何保持迁移实现最先进性能,提供标准化评估与数据集。
摘要:
我们推出了Style4D-Bench,这是首个专门为4D风格化设计的基准测试套件,旨在标准化评估并促进这一新兴领域的发展。Style4D-Bench包含:1)一个全面的评估协议,通过感知和定量指标衡量空间保真度、时间一致性和多视角一致性;2)一个强大的基线,为4D风格化进行了初步尝试;3)一个精选的高分辨率动态4D场景集合,具有多样化的运动和复杂的背景。为了建立强大的基线,我们提出了Style4D,一个基于4D高斯泼溅的新框架。它由三个关键组件组成:一个基本的4DGS场景表示以捕获可靠的几何结构,一个风格高斯表示利用轻量级的每高斯MLP进行时间和空间感知的外观控制,以及一个整体几何保持的风格迁移模块,旨在通过对比一致性学习和结构内容保留来增强时空一致性。在Style4D-Bench上的大量实验表明,Style4D在4D风格化中达到了最先进的性能,产生了具有稳定时间动态和一致多视角渲染的细粒度风格细节。我们期望Style4D-Bench成为基准测试和推进动态3D场景风格化渲染研究的重要资源。项目页面:https://becky-catherine.github.io/Style4D 。代码:https://github.com/Becky-catherine/Style4D-Bench 。
英文摘要:
We introduce Style4D-Bench, the first benchmark suite specifically designed for 4D stylization, with the goal of standardizing evaluation and facilitating progress in this emerging area. Style4D-Bench comprises: 1) a comprehensive evaluation protocol measuring spatial fidelity, temporal coherence, and multi-view consistency through both perceptual and quantitative metrics, 2) a strong baseline that make an initial attempt for 4D stylization, and 3) a curated collection of high-resolution dynamic 4D scenes with diverse motions and complex backgrounds. To establish a strong baseline, we present Style4D, a novel framework built upon 4D Gaussian Splatting. It consists of three key components: a basic 4DGS scene representation to capture reliable geometry, a Style Gaussian Representation that leverages lightweight per-Gaussian MLPs for temporally and spatially aware appearance control, and a Holistic Geometry-Preserved Style Transfer module designed to enhance spatio-temporal consistency via contrastive coherence learning and structural content preservation. Extensive experiments on Style4D-Bench demonstrate that Style4D achieves state-of-the-art performance in 4D stylization, producing fine-grained stylistic details with stable temporal dynamics and consistent multi-view rendering. We expect Style4D-Bench to become a valuable resource for benchmarking and advancing research in stylized rendering of dynamic 3D scenes. Project page: https://becky-catherine.github.io/Style4D . Code: https://github.com/Becky-catherine/Style4D-Bench .
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。