针织纱线图像的神经逆过程建模
Neural inverse procedural modeling of knitting yarns from images
摘要:
我们研究了神经逆过程建模的能力,以从所描绘的纱线样品的单个图像中推断具有纤维级细节的高质量过程纱线模型。虽然直接推断所有参数的基础上,一个单一的神经网络的纱线模型似乎是一个直观的选择,我们表明,纱线结构的复杂性方面的扭曲和迁移特性的所涉及的纤维可以更好地遇到在合奏的网络,专注于个人的特点。我们分析了不同的损失函数的影响,包括参数损失,以惩罚推断参数与地面实况注释的偏差,- 重建损失,以强制与训练图像相比针对所估计的参数生成的图像的类似统计,以及附加的正则化项,以显式地惩罚合成图像的潜码与训练图像中的真实图像的平均潜码之间的偏差。编码器的潜在空间。我们证明了精心设计的参数化,程序化纱线模型与各自的网络集成以及损失函数的组合,甚至允许在仅对合成数据进行训练时进行鲁棒的参数推断。由于我们的方法依赖于具有参数注释的纱线数据库的可用性,并且我们不知道这样的相应的可用数据集,因此据我们所知,我们还提供了具有关于相应纱线参数的注释的纱线图像的第一数据集。为此,我们使用了一种新的纱线生成器,提高了现实主义的生产结果比以前的方法。
英文摘要:
We investigate the capabilities of neural inverse procedural modeling to infer high-quality procedural yarn models with fiber-level details from single images of depicted yarn samples. While directly inferring all parameters of the underlying yarn model based on a single neural network may seem an intuitive choice, we show that the complexity of yarn structures in terms of twisting and migration characteristics of the involved fibers can be better encountered in terms of ensembles of networks that focus on individual characteristics. We analyze the effect of different loss functions including a parameter loss to penalize the deviation of inferred parameters to ground truth annotations, a reconstruction loss to enforce similar statistics of the image generated for the estimated parameters in comparison to training images as well as an additional regularization term to explicitly penalize deviations between latent codes of synthetic images and the average latent code of real images in the latent space of the encoder. We demonstrate that the combination of a carefully designed parametric, procedural yarn model with respective network ensembles as well as loss functions even allows robust parameter inference when solely trained on synthetic data. Since our approach relies on the availability of a yarn database with parameter annotations and we are not aware of such a respectively available dataset, we additionally provide, to the best of our knowledge, the first dataset of yarn images with annotations regarding the respective yarn parameters. For this purpose, we use a novel yarn generator that improves the realism of the produced results over previous approaches.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。