3DMM与3D关键点协同实现精确三维面部几何
Synergy between 3DMM and 3D Landmarks for Accurate 3D Facial Geometry
AI总结:
本文提出3DMM与三维关键点之间的表示循环协同过程,仅用简单网络操作即可实现快速、鲁棒且精确的完整三维面部几何预测。
摘要:
本工作研究从三维形变模型(3DMM)与三维面部关键点的协同过程中进行学习,以预测完整的三维面部几何,包括三维对齐、面部朝向和三维面部建模。我们的协同过程利用了一个针对3DMM参数与三维关键点的表示循环。三维关键点可以从由3DMM参数构建的面部网格中提取并精化。接下来,我们反转表示方向,并证明从稀疏三维关键点预测3DMM参数可以改善信息流动。二者共同构成了一个利用三维关键点与3DMM参数之间关系的协同过程,并协同贡献于更好的性能。我们在面部几何预测的全部任务上广泛验证了我们的贡献,并展示了在各种场景下这些任务上的优越且鲁棒的性能。特别地,我们仅采用简单且广泛使用的网络操作即可实现快速且准确的面部几何预测。代码与数据:https://choyingw.github.io/works/SynergyNet/
英文摘要:
This work studies learning from a synergy process of 3D Morphable Models (3DMM) and 3D facial landmarks to predict complete 3D facial geometry, including 3D alignment, face orientation, and 3D face modeling. Our synergy process leverages a representation cycle for 3DMM parameters and 3D landmarks. 3D landmarks can be extracted and refined from face meshes built by 3DMM parameters. We next reverse the representation direction and show that predicting 3DMM parameters from sparse 3D landmarks improves the information flow. Together we create a synergy process that utilizes the relation between 3D landmarks and 3DMM parameters, and they collaboratively contribute to better performance. We extensively validate our contribution on full tasks of facial geometry prediction and show our superior and robust performance on these tasks for various scenarios. Particularly, we adopt only simple and widely-used network operations to attain fast and accurate facial geometry prediction. Codes and data: https://choyingw.github.io/works/SynergyNet/
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。