arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2509.26055cs.GRcs.CVcs.LG

GaussEdit:基于文本和图像提示的自适应3D场景编辑

GaussEdit: Adaptive 3D Scene Editing with Text and Image Prompts

School of Computer and Data Engineering, NingboTech University(计算机与数据工程学院,宁波科技学院);Ningbo Institute, Zhejiang University(浙江大学宁波学院);School of Software Technology, Zhejiang University(软件技术学院,浙江大学);School of Big Data and Artificial Intelligence Management, Xi’an Jiaotong University(大数据与人工智能管理学院,西安交通大学);School of Computer Science and Technology, ShanDong University(计算机科学与技术学院,山东大学);Graphics & Geometric Computing Laboratory, School of Mathematical Sciences, University of Science and Technology of China(图形与几何计算实验室,数学科学学院,中国科学技术大学)

Zhenyu Shu, Junlong Yu, Kai Chao, Shiqing Xin, Ligang Liu

AI总结:

本研究提出GaussEdit框架,以3D高斯溅射为主干,通过三阶段流程结合文本与图像提示实现自适应3D场景编辑,在编辑精度、视觉保真度和速度上均优于现有方法。

摘要:

本文提出GaussEdit,一种由文本和图像提示引导的自适应3D场景编辑框架。GaussEdit以3D Gaussian Splatting(3D高斯溅射)作为场景表示的主干网络,通过三阶段流程实现便捷的感兴趣区域选择与高效编辑。第一阶段对3D高斯进行初始化,以保障编辑质量。第二阶段采用自适应全局-局部优化策略平衡全局场景一致性与局部细节编辑,并结合类别引导的正则化技术缓解Janus(双面)问题。最后阶段通过精细的图像到图像合成技术增强编辑对象的纹理,确保结果视觉真实且与给定提示高度契合。实验结果表明,GaussEdit在编辑精度、视觉保真度和处理速度上均优于现有方法。通过将用户指定概念成功嵌入3D场景,GaussEdit成为实现精细化、用户驱动3D场景编辑的有力工具,较传统方法有显著提升。

英文摘要:

This paper presents GaussEdit, a framework for adaptive 3D scene editing guided by text and image prompts. GaussEdit leverages 3D Gaussian Splatting as its backbone for scene representation, enabling convenient Region of Interest selection and efficient editing through a three-stage process. The first stage involves initializing the 3D Gaussians to ensure high-quality edits. The second stage employs an Adaptive Global-Local Optimization strategy to balance global scene coherence and detailed local edits and a category-guided regularization technique to alleviate the Janus problem. The final stage enhances the texture of the edited objects using a sophisticated image-to-image synthesis technique, ensuring that the results are visually realistic and align closely with the given prompts. Our experimental results demonstrate that GaussEdit surpasses existing methods in editing accuracy, visual fidelity, and processing speed. By successfully embedding user-specified concepts into 3D scenes, GaussEdit is a powerful tool for detailed and user-driven 3D scene editing, offering significant improvements over traditional methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑