3DGS-Drag:基于高斯分布的直观点基3D编辑
3DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D Editing
AI总结:
3DGS-Drag通过结合变形引导和扩散引导,实现高效直观的点基3D场景拖动编辑,提升几何内容编辑的性能与效率。
摘要:
3D内容创作的变革潜力通过生成模型的进步逐步得以实现。最近,直观拖动编辑与几何变化在2D编辑中受到广泛关注,但在3D场景中仍具挑战性。本文介绍3DGS-Drag——一种基于点的3D编辑框架,能够高效、直观地对真实3D场景进行拖动操作。我们的方法弥合了基于变形和基于2D编辑的3D编辑方法之间的差距,解决了其在几何相关内容编辑上的局限性。我们利用两个关键创新:利用3D高斯散点进行变形引导以实现一致的几何修改,以及扩散引导用于内容修正和视觉质量提升。渐进式编辑策略进一步支持了激进的3D拖动编辑。我们的方法能够实现多种编辑,包括运动变化、形状调整、修补和内容扩展。实验结果表明,3DGS-Drag在各种场景中均表现出色,实现了几何相关3D内容编辑的最先进性能。值得注意的是,编辑过程高效,单块RTX 4090 GPU上仅需10至20分钟。
英文摘要:
The transformative potential of 3D content creation has been progressively unlocked through advancements in generative models. Recently, intuitive drag editing with geometric changes has attracted significant attention in 2D editing yet remains challenging for 3D scenes. In this paper, we introduce 3DGS-Drag -- a point-based 3D editing framework that provides efficient, intuitive drag manipulation of real 3D scenes. Our approach bridges the gap between deformation-based and 2D-editing-based 3D editing methods, addressing their limitations to geometry-related content editing. We leverage two key innovations: deformation guidance utilizing 3D Gaussian Splatting for consistent geometric modifications and diffusion guidance for content correction and visual quality enhancement. A progressive editing strategy further supports aggressive 3D drag edits. Our method enables a wide range of edits, including motion change, shape adjustment, inpainting, and content extension. Experimental results demonstrate the effectiveness of 3DGS-Drag in various scenes, achieving state-of-the-art performance in geometry-related 3D content editing. Notably, the editing is efficient, taking 10 to 20 minutes on a single RTX 4090 GPU.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。