NeRF-Texture：合成神经辐射场纹理
NeRF-Texture: Synthesizing Neural Radiance Field Textures
AI总结：
针对真实世界含3D介观结构纹理难以用2D方法建模的问题，提出NeRF-Texture方法，通过解耦介观结构与基础形状、潜在特征块匹配及聚类约束，实现平面和曲面的高质量NeRF纹理合成。
摘要：
纹理合成是计算机图形学中的一个基础问题，可惠及多种应用。现有方法在处理2D图像纹理方面效果显著。但相比之下，许多真实世界的纹理在3D几何空间中包含介观结构，例如草、树叶和织物，仅使用2D图像纹理无法对其进行有效建模。我们提出了一种基于神经辐射场（Neural Radiance Fields, NeRF）的新型纹理合成方法，可从给定的多视图图像中捕获并合成纹理。在提出的NeRF纹理表示中，具有精细几何细节的场景被解耦为介观结构纹理和底层基础形状。这使得带有介观结构的纹理能够作为位于基础形状上的潜在特征被有效学习，这些特征会被输入到同步训练的NeRF解码器中，以表征丰富的视图相关外观。借助这种隐式表示，我们可以通过潜在特征的块匹配来合成基于NeRF的纹理。然而，重建内容空间与潜在特征空间的度量标准之间的不一致可能会降低合成质量。为了提升匹配性能，我们进一步通过引入聚类约束来正则化潜在特征的分布。除了在平面域上生成NeRF纹理外，我们的方法还能在曲面上合成NeRF纹理，这具有实际应用价值。实验结果与评估验证了我们方法的有效性。
英文摘要：
Texture synthesis is a fundamental problem in computer graphics that would benefit various applications. Existing methods are effective in handling 2D image textures. In contrast, many real-world textures contain meso-structure in the 3D geometry space, such as grass, leaves, and fabrics, which cannot be effectively modeled using only 2D image textures. We propose a novel texture synthesis method with Neural Radiance Fields (NeRF) to capture and synthesize textures from given multi-view images. In the proposed NeRF texture representation, a scene with fine geometric details is disentangled into the meso-structure textures and the underlying base shape. This allows textures with meso-structure to be effectively learned as latent features situated on the base shape, which are fed into a NeRF decoder trained simultaneously to represent the rich view-dependent appearance. Using this implicit representation, we can synthesize NeRF-based textures through patch matching of latent features. However, inconsistencies between the metrics of the reconstructed content space and the latent feature space may compromise the synthesis quality. To enhance matching performance, we further regularize the distribution of latent features by incorporating a clustering constraint. In addition to generating NeRF textures over a planar domain, our method can also synthesize NeRF textures over curved surfaces, which are practically useful. Experimental results and evaluations demonstrate the effectiveness of our approach.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
