NeuMIP:多分辨率神经材料
NeuMIP: Multi-Resolution Neural Materials
摘要:
我们提出了NeuMIP,一种神经方法,用于表示和渲染各种不同尺度的材料外观。经典的预过滤(mipmapping)方法可以很好地处理简单的材质属性,如漫反射颜色,但无法推广到法线,自阴影,纤维或更复杂的微观结构和反射率。在这项工作中,我们将传统的mipmap金字塔推广到神经纹理的金字塔,并结合了一个完全连接的网络。我们还介绍了神经偏移,一种新的方法,允许渲染材料与复杂的视差效果,而无需任何镶嵌。这概括了经典的视差映射,但在没有任何显式高度场监督的情况下进行训练。我们的系统中的神经材料支持7维查询,包括位置,传入和传出方向,以及所需的过滤器内核大小。这些材质的存储量很小(除了纹理通道较多外,与标准mipmapping的数量级相当),并且可以集成到常用的蒙特卡罗路径追踪系统中。我们在各种材料上演示了我们的方法,从而在不同细节层次上产生复杂的外观,并具有精确的视差,自阴影和其他效果。
英文摘要:
We propose NeuMIP, a neural method for representing and rendering a variety of material appearances at different scales. Classical prefiltering (mipmapping) methods work well on simple material properties such as diffuse color, but fail to generalize to normals, self-shadowing, fibers or more complex microstructures and reflectances. In this work, we generalize traditional mipmap pyramids to pyramids of neural textures, combined with a fully connected network. We also introduce neural offsets, a novel method which allows rendering materials with intricate parallax effects without any tessellation. This generalizes classical parallax mapping, but is trained without supervision by any explicit heightfield. Neural materials within our system support a 7-dimensional query, including position, incoming and outgoing direction, and the desired filter kernel size. The materials have small storage (on the order of standard mipmapping except with more texture channels), and can be integrated within common Monte-Carlo path tracing systems. We demonstrate our method on a variety of materials, resulting in complex appearance across levels of detail, with accurate parallax, self-shadowing, and other effects.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。