3DSceneEditor: 基于高斯散射的可控3D场景编辑
3DSceneEditor: Controllable 3D Scene Editing with Gaussian Splatting
AI总结：
本文提出3DSceneEditor，通过高斯散射实现高效精准的3D场景编辑，整合实例分割模型与CLIP实现语义对齐，支持对象添加、重定位等操作，实验表明其在精度和效率上优于现有方法。
摘要：
传统3D场景创建过程繁琐且昂贵，需精细配置3D资产和环境。生成式AI的进展如文本到3D和图像到3D方法大幅降低了复杂度和成本。然而，现有复杂3D场景编辑技术仍依赖交互式多步骤2D到3D投影方法和扩散技术，控制精度不足且影响交互速率。本文提出3DSceneEditor，一种基于3D的交互式编辑范式，利用高斯散射实现高效高质量的3D场景编辑。该方法通过流线型3D管道实现直接的高斯操作，整合预训练实例分割模型进行语义标注，采用零样本定位方法与CLIP对齐目标对象与用户提示，并直接在高斯上应用场景修改操作，如对象添加、重定位、着色、替换和移除。实验结果表明，3DSceneEditor在编辑精度和效率上均优于现有最先进方法，建立了高效交互3D场景定制的新基准。
英文摘要：
The creation of 3D scenes has traditionally been both labor-intensive and costly, requiring designers to meticulously configure 3D assets and environments. Recent advancements in generative AI, including text-to-3D and image-to-3D methods, have dramatically reduced the complexity and cost of this process. However, current techniques for editing complex 3D scenes continue to rely on generally interactive multi-step, 2D-to-3D projection methods and diffusion-based techniques, which often lack precision in control and hamper interactive-rate performance. In this work, we propose ***3DSceneEditor***, a fully 3D-based paradigm for interactive-rate, precise editing of intricate 3D scenes using Gaussian Splatting. Unlike conventional methods, 3DSceneEditor operates through a streamlined 3D pipeline, enabling direct Gaussian-based manipulation for efficient, high-quality edits based on input prompts. The proposed framework (i) integrates a pre-trained instance segmentation model for semantic labeling; (ii) employs a zero-shot grounding approach with CLIP to align target objects with user prompts; and (iii) applies scene modifications, such as object addition, repositioning, recoloring, replacing, and removal--directly on Gaussians. Extensive experimental results show that 3DSceneEditor surpasses existing state-of-the-art techniques in terms of both editing precision and efficiency, establishing a new benchmark for efficient and interactive 3D scene customization.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
