EVA：从多视角视频生成高表现力虚拟化身
EVA: Expressive Virtual Avatars from Multi-view Videos
AI总结：
针对现有人形化身方法因表情动作表示纠缠、可控性不足的问题，提出EVA框架，通过两层模型与解耦式3D高斯外观建模，实现表情、动作与手势的独立实时高保真控制，性能超越现有最优方法。
摘要：
随着神经渲染与动作捕捉算法的最新进展，照片级真实感人形化身建模已取得显著进展，为虚拟现实、增强现实、远程通信以及游戏、影视、医疗等行业的应用解锁了巨大潜力。然而，现有方法由于对面部表情与身体动作采用纠缠表示，无法为人形化身提供完整、忠实且富有表现力的控制。\n在本研究中，我们提出了高表现力虚拟化身（Expressive Virtual Avatars，EVA）——这是一个针对特定表演者、完全可控且高表现力的人形化身框架，可实时生成高保真、逼真的渲染效果，同时支持面部表情、身体动作与手势的独立控制。具体而言，我们的方法将人形化身设计为两层模型：高表现力模板几何层与3D高斯外观层。\n首先，我们提出了一种高表现力模板跟踪算法，该算法利用由粗到精的优化，从多视角视频中准确恢复身体动作、面部表情与非刚性形变参数。接着，我们提出了一种新颖的解耦式3D高斯外观模型，旨在有效分离身体与面部的外观。与统一高斯估计方法不同，我们的方法采用两个专门且独立的模块分别对身体和面部进行建模。\n实验结果表明，EVA在渲染质量与表现力方面均超越了当前最优方法，验证了其在创建全身化身方面的有效性。本研究是迈向完全可驱动数字人模型的重要进展，能够生成忠实复现人体几何结构与外观的逼真数字化身。
英文摘要：
With recent advancements in neural rendering and motion capture algorithms, remarkable progress has been made in photorealistic human avatar modeling, unlocking immense potential for applications in virtual reality, augmented reality, remote communication, and industries such as gaming, film, and medicine. However, existing methods fail to provide complete, faithful, and expressive control over human avatars due to their entangled representation of facial expressions and body movements. In this work, we introduce Expressive Virtual Avatars (EVA), an actor-specific, fully controllable, and expressive human avatar framework that achieves high-fidelity, lifelike renderings in real time while enabling independent control of facial expressions, body movements, and hand gestures. Specifically, our approach designs the human avatar as a two-layer model: an expressive template geometry layer and a 3D Gaussian appearance layer. First, we present an expressive template tracking algorithm that leverages coarse-to-fine optimization to accurately recover body motions, facial expressions, and non-rigid deformation parameters from multi-view videos. Next, we propose a novel decoupled 3D Gaussian appearance model designed to effectively disentangle body and facial appearance. Unlike unified Gaussian estimation approaches, our method employs two specialized and independent modules to model the body and face separately. Experimental results demonstrate that EVA surpasses state-of-the-art methods in terms of rendering quality and expressiveness, validating its effectiveness in creating full-body avatars. This work represents a significant advancement towards fully drivable digital human models, enabling the creation of lifelike digital avatars that faithfully replicate human geometry and appearance.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
