Everything's Talkin '：Pareidolia Face Reenactment
Everything's Talkin': Pareidolia Face Reenactment
摘要：
我们提出了一个新的应用方向命名为Pareidolia人脸再现，它被定义为动画一个静态的虚幻的脸，以移动在视频中的人脸。由于幻想症人脸再现与传统人脸再现之间的巨大差异，引入了两个主要挑战，即，形状方差和纹理方差。在这项工作中，我们提出了一种新的参数无监督重演算法来解决这两个挑战。具体来说，我们建议分解成三个连锁过程的重演：形状建模，运动传输和纹理合成。通过分解，我们引入了三个关键组成部分，即，参数化形状建模、可扩展的运动变换和无监督纹理合成，克服了视差人脸的显著变化所带来的问题。大量的实验表明，我们的方法在定性和定量上的优越性能。代码、模型和数据可以在我们的项目页面上找到。
英文摘要：
We present a new application direction named Pareidolia Face Reenactment, which is defined as animating a static illusory face to move in tandem with a human face in the video. For the large differences between pareidolia face reenactment and traditional human face reenactment, two main challenges are introduced, i.e., shape variance and texture variance. In this work, we propose a novel Parametric Unsupervised Reenactment Algorithm to tackle these two challenges. Specifically, we propose to decompose the reenactment into three catenate processes: shape modeling, motion transfer and texture synthesis. With the decomposition, we introduce three crucial components, i.e., Parametric Shape Modeling, Expansionary Motion Transfer and Unsupervised Texture Synthesizer, to overcome the problems brought by the remarkably variances on pareidolia faces. Extensive experiments show the superior performance of our method both qualitatively and quantitatively. Code, model and data are available on our project page.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
