基于局部特征投影的三维生成模型潜在解耦
3D Generative Model Latent Disentanglement via Local Eigenprojection
AI总结:
本文提出一种基于谱几何的新型损失函数,通过鼓励3D网格VAEs或GANs的潜在变量遵循身份属性的局部特征投影,实现了局部形状属性的解耦生成,在保持良好生成能力和相当训练时间的同时,显著提升了潜在解耦效果。
摘要:
设计逼真的数字人极为复杂。用于简化其底层几何形状创建的大多数数据驱动生成模型无法控制局部形状属性的生成。本文通过引入一种基于谱几何的新型损失函数来克服这一限制,该函数适用于不同的基于神经网络的3D头部和身体网格生成模型。通过鼓励网格变分自编码器(VAEs)或生成对抗网络(GANs)的潜在变量遵循身份属性的局部特征投影,我们改进了潜在解耦并正确解耦了属性创建。实验结果表明,我们的局部特征投影解耦(LED)模型不仅相较于最先进技术提供了更好的解耦,而且保持了良好的生成能力,其训练时间与模型的原始实现相当。
英文摘要:
Designing realistic digital humans is extremely complex. Most data-driven generative models used to simplify the creation of their underlying geometric shape do not offer control over the generation of local shape attributes. In this paper, we overcome this limitation by introducing a novel loss function grounded in spectral geometry and applicable to different neural-network-based generative models of 3D head and body meshes. Encouraging the latent variables of mesh variational autoencoders (VAEs) or generative adversarial networks (GANs) to follow the local eigenprojections of identity attributes, we improve latent disentanglement and properly decouple the attribute creation. Experimental results show that our local eigenprojection disentangled (LED) models not only offer improved disentanglement with respect to the state-of-the-art, but also maintain good generation capabilities with training times comparable to the vanilla implementations of the models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。