3DitScene：通过语言引导的解耦高斯泼溅编辑任意场景
3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting
AI总结：
3DitScene提出语言引导的解耦高斯泼溅框架，统一2D到3D场景编辑，支持全局与个体精细控制，实验验证其有效性与多功能性。
摘要：
场景图像编辑对于娱乐、摄影和广告设计至关重要。现有方法仅专注于2D单个物体或3D全局场景编辑，导致缺乏一种统一的方法来在3D层面以不同粒度级别有效控制和操纵场景。在这项工作中，我们提出了3DitScene，一种新颖且统一的场景编辑框架，利用语言引导的解耦高斯泼溅，实现从2D到3D的无缝编辑，允许对场景组成和单个物体进行精确控制。我们首先引入通过生成先验和优化技术精炼的3D高斯。然后，来自CLIP的语言特征将语义引入3D几何以实现物体解耦。凭借解耦的高斯，3DitScene允许在全局和个体层面进行操纵，革新创意表达并增强对场景和物体的控制能力。实验结果表明3DitScene在场景图像编辑中的有效性和多功能性。代码和在线演示可在我们的项目主页找到：https://zqh0253.github.io/3DitScene/。
英文摘要：
Scene image editing is crucial for entertainment, photography, and advertising design. Existing methods solely focus on either 2D individual object or 3D global scene editing. This results in a lack of a unified approach to effectively control and manipulate scenes at the 3D level with different levels of granularity. In this work, we propose 3DitScene, a novel and unified scene editing framework leveraging language-guided disentangled Gaussian Splatting that enables seamless editing from 2D to 3D, allowing precise control over scene composition and individual objects. We first incorporate 3D Gaussians that are refined through generative priors and optimization techniques. Language features from CLIP then introduce semantics into 3D geometry for object disentanglement. With the disentangled Gaussians, 3DitScene allows for manipulation at both the global and individual levels, revolutionizing creative expression and empowering control over scenes and objects. Experimental results demonstrate the effectiveness and versatility of 3DitScene in scene image editing. Code and online demo can be found at our project homepage: https://zqh0253.github.io/3DitScene/.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
