arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.18488cs.CV
收藏

TexEditor: 保持结构的文本驱动纹理编辑

TexEditor: Structure-Preserving Text-Driven Texture Editing

Nanjing University(南京大学);Shan Dong University(山东大学);Zhejiang University(浙江大学)

Bo Zhao, Yihang Liu, Chenfeng Zhang, Huan Yang, Kun Gai, Wei Ji

AI总结:

本文提出TexEditor,通过数据和训练视角增强结构保持,利用TexBlender和StructureNFT提升纹理编辑效果,并引入TexBench验证其通用性。

摘要:

文本引导的纹理编辑旨在修改物体外观同时保持底层几何结构。然而,我们的实证分析表明,即使是最先进的编辑模型也难以在纹理编辑中保持结构一致性。受此启发,我们从数据和训练角度联合增强结构保持,构建基于Qwen-Image-Edit-2509的TexEditor模型。首先,我们构建了使用Blender生成的高质量SFT数据集TexBlender,为冷启动提供强结构先验。其次,我们引入StructureNFT,一种基于强化学习的方法,整合结构保持损失将SFT期间学到的结构先验转移到现实场景。此外,由于现有基准的现实性和评估覆盖有限,我们引入TexBench,一个通用的现实基准用于文本引导的纹理编辑。在现有Blender基于纹理基准和我们的TexBench上的大量实验表明,TexEditor在Nano Banana Pro等强基线中表现一致。此外,我们评估了TexEditor在通用基准ImgEdit上的泛化能力。我们的代码和数据可在https://github.com/KlingAIResearch/TexEditor获取。

英文摘要:

Text-guided texture editing aims to modify object appearance while preserving the underlying geometric structure. However, our empirical analysis reveals that even SOTA editing models frequently struggle to maintain structural consistency during texture editing, despite the intended changes being purely appearance-related. Motivated by this observation, we jointly enhance structure preservation from both data and training perspectives, and build TexEditor, a dedicated texture editing model based on Qwen-Image-Edit-2509. Firstly, we construct TexBlender, a high-quality SFT dataset generated with Blender, which provides strong structural priors for a cold start. Sec- ondly, we introduce StructureNFT, a RL-based approach that integrates structure-preserving losses to transfer the structural priors learned during SFT to real-world scenes. Moreover, due to the limited realism and evaluation coverage of existing benchmarks, we introduce TexBench, a general-purpose real-world benchmark for text-guided texture editing. Extensive experiments on existing Blender-based texture benchmarks and our TexBench show that TexEditor consistently outperforms strong baselines such as Nano Banana Pro. In addition, we assess TexEditor on the general purpose benchmark ImgEdit to validate its generalization. Our code and data are available at https://github.com/KlingAIResearch/TexEditor.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑