arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.36098cs.GR
收藏

生成多视图渲染图的纹理整合

Texture Consolidation of Generated Multi-View Renderings

Johns Hopkins University(约翰斯·霍普金斯大学);Adobe Research(Adobe 研究院);Adobe Firefly Foundry(Adobe Firefly 工厂)

Hongyi Liu, Yifan Wang, Vladimir G. Kim, Misha Kazhdan

AI总结:

该研究提出一种系统,通过反向投影渲染图、求解网格流场、梯度域拼接三步,将稀疏多视图渲染图整合为连贯纹理图像,解决了现代图像生成渲染图跨视图不一致的问题。

摘要:

我们提出了一种系统,用于将稀疏的多视图渲染图整合为单一连贯的纹理图像,为在几何处理流程中集成图像生成的生成模型提供了框架。给定一张纹理图集化的三角形网格和一组带有关联相机参数的渲染图,我们通过以下步骤生成纹理图像:(1) 将渲染图反向投影到网格上,以获得带有归一化颜色和置信度的纹理图像;(2) 考虑关联的置信度,求解网格上的流场,使颜色相互对齐;(3) 再次结合置信度,使用梯度域拼接将配准后的颜色融合为单一纹理图像。我们的方法是对现有多视图图像生成技术的补充,利用基于网格的光流和纹理空间拼接,解决了现代图像生成流程虽能生成极具说服力的渲染图,但难以生成跨视图一致的渲染图的挑战。代码可在该 https URL 获取。

英文摘要:

We present a system for consolidating a sparse set of multi-view renderings into a single coherent texture image, providing a framework for integrating generative models for image generation within the geometry-processing pipeline. Given a texture-atlased triangle mesh and a set of renderings with associated camera parameters, we generate the texture image by: (1) back-projecting the renderings onto the mesh to obtain texture images with normalized colors and confidences; (2) solving for flow-fields on the mesh that align the colors to each other, taking into account the associated confidences; and (3) fusing the registered colors into a single texture image using gradient-domain stitching, again incorporating confidences. Our approach complements existing techniques for multi-view image generation, leveraging mesh-based optical flow and texture-space stitching. In doing so it addresses the challenge that while modern image generation pipelines generate highly convincing renderings, they struggle to produce renderings that are consistent across views. Code is available at https://github.com/hliuw/TextureConsolidation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑