arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.12157cs.CVcs.GR
收藏

TexSpot: 基于空间均匀点潜在表示的3D纹理增强

TexSpot: 3D Texture Enhancement with Spatially-uniform Point Latent Representation

Shenzhen University(深圳大学)

Ziteng Lu, Yushuang Wu, Chongjie Ye, Yuda Qiu, Jing Shao, Xiaoyang Guo, Jiaqing Zhou, Tianlei Hu, Kun Zhou, Xiaoguang Han

AI总结:

TexSpot提出一种基于扩散的3D纹理增强框架,通过融合点与UV表示的Texlet方法,提升纹理生成的视觉保真度和几何一致性。

摘要:

高质量的3D纹理生成仍是一个根本性挑战,因为当前主流多视角扩散管道固有地存在视角不一致的问题。现有表示方法要么依赖于UV图,这在展开过程中会受到扭曲;要么是基于点的方法,这些方法将纹理保真度紧密耦合到几何密度上,从而限制了高分辨率纹理生成。为了解决这些限制,我们引入了TexSpot,一种基于扩散的纹理增强框架。其核心是Texlet,一种新的3D纹理表示方法,它将基于点的3D纹理的几何表达能力与基于UV的表示的紧凑性相结合。每个Texlet潜在向量通过2D编码器编码局部纹理块,并进一步通过3D编码器聚合以纳入全局形状上下文。一个级联的3D到2D解码器重建高质量的纹理块,从而实现Texlet空间的学习。利用这种表示,我们训练了一个扩散变压器,该变压器以Texlet为条件来细化和增强由多视角扩散方法生成的纹理。广泛的实验表明,TexSpot在视觉保真度、几何一致性以及鲁棒性方面显著优于现有的最先进3D纹理生成和增强方法。项目页面:https://texlet-arch.github.io/TexSpot-page。

英文摘要:

High-quality 3D texture generation remains a fundamental challenge due to the view-inconsistency inherent in current mainstream multi-view diffusion pipelines. Existing representations either rely on UV maps, which suffer from distortion during unwrapping, or point-based methods, which tightly couple texture fidelity to geometric density that limits high-resolution texture generation. To address these limitations, we introduce TexSpot, a diffusion-based texture enhancement framework. At its core is Texlet, a novel 3D texture representation that merges the geometric expressiveness of point-based 3D textures with the compactness of UV-based representation. Each Texlet latent vector encodes a local texture patch via a 2D encoder and is further aggregated using a 3D encoder to incorporate global shape context. A cascaded 3D-to-2D decoder reconstructs high-quality texture patches, enabling the Texlet space learning. Leveraging this representation, we train a diffusion transformer conditioned on Texlets to refine and enhance textures produced by multi-view diffusion methods. Extensive experiments demonstrate that TexSpot significantly improves visual fidelity, geometric consistency, and robustness over existing state-of-the-art 3D texture generation and enhancement approaches. Project page: https://texlet-arch.github.io/TexSpot-page.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑