HACK：学习用于高保真动画的参数化头颈模型
HACK: Learning a Parametric Head and Neck Model for High-fidelity Animation
AI总结：
本文提出HACK参数化头颈模型，利用多模态数据（3D超声与多视角光度法）解耦颈部运动、表情和外观，实现高保真动画控制。
摘要：
在开发数字人的参数化模型方面已经取得了显著进展，各种方法集中于人体、手或脸等部分。然而，颈部等连接部分在这些模型中被忽视，丰富的解剖学先验往往未被利用。在本文中，我们介绍了HACK（Head-And-neCK），一种用于构建数字人头颈区域的新型参数化模型。我们的模型旨在解耦颈部与喉部的全谱运动、面部表情以及外观变化，提供个性化且解剖学一致的控制，特别是针对颈部区域。为了构建我们的HACK模型，我们采集了一个包含不同面部表情下头颈的综合多模态数据集。我们采用3D超声成像方案来提取内部生物力学结构，即颈椎七块椎骨的精确3D旋转信息。然后，我们采用多视角光度法来捕捉不同受试者的几何形状和基于物理的纹理，这些受试者表现出各种静态表情以及连续的头颈运动。利用多模态数据集，我们通过将3D头颈描绘从中性表情和其余骨骼姿态中分离为各种形状、姿态、表情和喉部混合形状来训练参数化HACK模型。我们采用解剖学一致的骨骼设计用于颈椎区域，表情与面部动作单元相关联，以便于艺术家友好的控制。HACK将头颈视为一个统一实体，提供更准确和富有表现力的控制，特别是针对颈部区域，达到新的真实感水平。这种方法对众多应用具有显著益处，并支持头颈之间的相互关联分析，用于细粒度运动合成与迁移。
英文摘要：
Significant advancements have been made in developing parametric models for digital humans, with various approaches concentrating on parts such as the human body, hand, or face. Nevertheless, connectors such as the neck have been overlooked in these models, with rich anatomical priors often unutilized. In this paper, we introduce HACK (Head-And-neCK), a novel parametric model for constructing the head and cervical region of digital humans. Our model seeks to disentangle the full spectrum of neck and larynx motions, facial expressions, and appearance variations, providing personalized and anatomically consistent controls, particularly for the neck regions. To build our HACK model, we acquire a comprehensive multi-modal dataset of the head and neck under various facial expressions. We employ a 3D ultrasound imaging scheme to extract the inner biomechanical structures, namely the precise 3D rotation information of the seven vertebrae of the cervical spine. We then adopt a multi-view photometric approach to capture the geometry and physically-based textures of diverse subjects, who exhibit a diverse range of static expressions as well as sequential head-and-neck movements. Using the multi-modal dataset, we train the parametric HACK model by separating the 3D head and neck depiction into various shape, pose, expression, and larynx blendshapes from the neutral expression and the rest skeletal pose. We adopt an anatomically-consistent skeletal design for the cervical region, and the expression is linked to facial action units for artist-friendly controls. HACK addresses the head and neck as a unified entity, offering more accurate and expressive controls, with a new level of realism, particularly for the neck regions. This approach has significant benefits for numerous applications and enables inter-correlation analysis between head and neck for fine-grained motion synthesis and transfer.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
