arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.15533cs.CV
收藏

UMAS3D:统一的无掩码3D编辑方法,具备区域自适应源保留能力

UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservation

College of Artificial Intelligence, Zhejiang University(浙江大学人工智能学院);ReLER

Xianlin Zeng, Xiaolong Shen, Ruijie Quan, Yi Yang

AI总结:

UMAS3D是一种无训练、无反演、无需外部3D掩码的统一3D编辑框架,通过MARM与SGPS技术实现多样编辑任务,可有效保留未编辑的源内容。

摘要:

3D编辑旨在根据用户意图修改现有3D资产,同时保留预期编辑区域外的几何结构与外观。现有方法通常依赖特定任务训练、源3D反演或外部3D掩码,缺乏适用于多样编辑条件与任务的统一框架。本文提出UMAS3D,这是一种无训练、无反演且无需外部3D掩码的统一3D编辑框架。UMAS3D将文本、边界框、参考图像及其组合转换为通用目标视图引导,之后添加、删除、修改、外观调整及姿态编辑共享相同的下游3D生成流程。其核心思路是将在线编辑区域估计与区域感知源保留相结合:无掩码自适应区域建模(MARM)从源-目标视觉差异初始化编辑/保留先验,并随目标结构演化逐步优化;源引导保留控制(SGPS)约束当前保留区域状态,以在保留源几何与外观的同时不抑制目标驱动的变化。实验表明,UMAS3D支持添加、删除、修改、外观调整及姿态编辑,同时能有效保留未编辑的源内容,这些进展使UMAS成为适用于多样编辑条件的灵活且源保留型3D编辑统一框架。

英文摘要:

3D editing aims to modify an existing 3D asset according to user intent while preserving geometry and appearance outside the intended edit region. Existing methods often rely on task-specific training, source-3D inversion, or external 3D masks, and lack a unified framework for diverse editing conditions and tasks. We propose UMAS3D, a unified 3D editing framework that is training-free, inversion-free, and free from external 3D masks. UMAS3D converts text, bounding boxes, reference images, and their combinations into common target-view guidance, after which addition, deletion, modification, appearance, and pose editing share the same downstream 3D generation process. Our key insight is to couple online edit-region estimation with region-aware source preservation. Mask-Free Adaptive Region Modeling (MARM) initializes an Edit/Keep prior from source-target visual differences and progressively refines it as the target structure evolves, while Source-Guided Preservation Steering (SGPS) constrains the current Keep-region states to retain source geometry and appearance without suppressing target-driven changes. Experiments show that UMAS3D supports addition, deletion, modification, appearance, and pose editing while effectively preserving unedited source content. These advances make UMAS3D a unified framework for flexible and source-preserving 3D editing across diverse editing conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑