arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.09820cs.GR
收藏

Rig-space神经渲染

Rig-space Neural Rendering

Dominik Borer, Lu Yuhang, Laura Wuelfroth, Jakob Buhmann, Martin Guay

摘要:

电影制作使用高分辨率的3d角色和复杂的专有设备来创建最高质量的图像。不幸的是,这些3d资产通常与用于游戏、混合现实和实时预可视化的实时图形引擎不兼容。因此,3d角色需要重新建模和重新装配,以适应这些新的应用,这需要数周的工作和艺术批准。我们解决这个问题的方法是学习一个紧凑的基于图像的原始3d角色渲染,直接以装备参数为条件。我们的想法是以许多不同的姿势和视图渲染角色,并直接从钻机参数训练深度神经网络来渲染高分辨率图像。已经提出了许多神经渲染技术来从2D骨架或几何和UV贴图进行渲染。然而,这些需要手动工作,并且不保持与操纵装备部件的动画师工作流以及内插装备参数的实时游戏引擎流水线兼容。我们扩展我们的架构,以支持动态重新照明和组成与其他3d对象在场景中。我们设计了一个网络,有效地生成多个场景特征图,如法线,深度,阴影和遮罩,这些特征图与其他场景对象组成,形成最终的图像。

英文摘要:

Movie productions use high resolution 3d characters with complex proprietary rigs to create the highest quality images possible for large displays. Unfortunately, these 3d assets are typically not compatible with real-time graphics engines used for games, mixed reality and real-time pre-visualization. Consequently, the 3d characters need to be re-modeled and re-rigged for these new applications, requiring weeks of work and artistic approval. Our solution to this problem is to learn a compact image-based rendering of the original 3d character, conditioned directly on the rig parameters. Our idea is to render the character in many different poses and views, and to train a deep neural network to render high resolution images, from the rig parameters directly. Many neural rendering techniques have been proposed to render from 2d skeletons, or geometry and UV maps. However these require manual work, and to do not remain compatible with the animator workflow of manipulating rig widgets, as well as the real-time game engine pipeline of interpolating rig parameters. We extend our architecture to support dynamic re-lighting and composition with other 3d objects in the scene. We designed a network that efficiently generates multiple scene feature maps such as normals, depth, albedo and mask, which are composed with other scene objects to form the final image.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑