SVG-Head：用于高保真头部重建与实时编辑的混合表面-体积Gaussians
SVG-Head: Hybrid Surface-Volumetric Gaussians for High-Fidelity Head Reconstruction and Real-Time Editing
AI总结：
提出SVG-Head混合表示，通过表面与体积Gaussians结合FLAME网格实现高保真头部重建，并支持实时外观编辑。
摘要：
创建高保真且可编辑的头部虚拟人是计算机视觉与图形学中的关键挑战，推动了众多AR/VR应用。尽管近期进展实现了逼真的渲染和合理的动画，但由于几何与全局外观的隐式表示和耦合建模，头部编辑（尤其是实时外观编辑）仍具挑战。为此，我们提出Surface-Volumetric Gaussian Head Avatar（SVG-Head），一种新型混合表示，通过绑定在FLAME网格上的3D Gaussians显式建模几何，并利用解耦的纹理图像捕捉全局外观。技术上，它包含两类Gaussians：surface Gaussians使用可学习的纹理图像显式建模头部外观，促进实时纹理编辑；volumetric Gaussians增强非朗伯区域（如嘴唇和头发）的重建质量。为建模3D世界与纹理空间之间的对应关系，我们提供一种网格感知的Gaussian UV映射方法，利用FLAME网格给出的UV坐标获取清晰的纹理图像和实时渲染速度。进一步设计了分层优化策略，以追求重建质量和编辑灵活性的最佳性能。在NeRSemble数据集上的实验表明，SVG-Head不仅生成高保真渲染结果，还是首个为Gaussian头部虚拟人获取显式纹理图像并支持实时外观编辑的方法。
英文摘要：
Creating high-fidelity and editable head avatars is a pivotal challenge in computer vision and graphics, boosting many AR/VR applications. While recent advancements have achieved photorealistic renderings and plausible animation, head editing, especially real-time appearance editing, remains challenging due to the implicit representation and entangled modeling of the geometry and global appearance. To address this, we propose Surface-Volumetric Gaussian Head Avatar (SVG-Head), a novel hybrid representation that explicitly models the geometry with 3D Gaussians bound on a FLAME mesh and leverages disentangled texture images to capture the global appearance. Technically, it contains two types of Gaussians, in which surface Gaussians explicitly model the appearance of head avatars using learnable texture images, facilitating real-time texture editing, while volumetric Gaussians enhance the reconstruction quality of non-Lambertian regions (e.g., lips and hair). To model the correspondence between 3D world and texture space, we provide a mesh-aware Gaussian UV mapping method, which leverages UV coordinates given by the FLAME mesh to obtain sharp texture images and real-time rendering speed. A hierarchical optimization strategy is further designed to pursue the optimal performance in both reconstruction quality and editing flexibility. Experiments on the NeRSemble dataset show that SVG-Head not only generates high-fidelity rendering results, but also is the first method to obtain explicit texture images for Gaussian head avatars and support real-time appearance editing.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
