arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.06901cs.CV
收藏

基于双域特征流的多视错觉纹理生成

Texture Generation Using Dual-Domain Feature Flow with Multi-View Hallucinations

Seoul National University(首尔大学);Gachon University(嘉泉大学)

Seunggyu Chang, Jungchan Cho, Songhwai Oh

摘要:

我们提出了一个双域生成模型来估计从一个单一的图像着色的三维人体模型的纹理图。在估计纹理贴图时,单个图像是不够的,因为它仅显示3D对象的一个面。为了提供足够的信息来估计一个完整的纹理图,所提出的模型同时产生多视图幻觉在图像域和估计的纹理图在纹理域。在生成过程中,每个域生成器通过基于流的局部注意力机制交换特征。以这种方式,所提出的模型可以估计利用丰富的多视图图像特征的纹理映射,从其中生成多视图幻觉。因此,估计的纹理贴图在整个区域上包含一致的颜色和图案。实验结果表明,该模型在估计可直接绘制的纹理图方面具有优越性,适用于三维动画绘制。此外,我们的模型还提高了在图像域的姿态和视点转移任务的整体生成质量。

英文摘要:

We propose a dual-domain generative model to estimate a texture map from a single image for colorizing a 3D human model. When estimating a texture map, a single image is insufficient as it reveals only one facet of a 3D object. To provide sufficient information for estimating a complete texture map, the proposed model simultaneously generates multi-view hallucinations in the image domain and an estimated texture map in the texture domain. During the generating process, each domain generator exchanges features to the other by a flow-based local attention mechanism. In this manner, the proposed model can estimate a texture map utilizing abundant multi-view image features from which multiview hallucinations are generated. As a result, the estimated texture map contains consistent colors and patterns over the entire region. Experiments show the superiority of our model for estimating a directly render-able texture map, which is applicable to 3D animation rendering. Furthermore, our model also improves an overall generation quality in the image domain for pose and viewpoint transfer tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑