arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.09005cs.CVcs.HC
收藏

人体与面部运动的综述:数据集、性能评估指标和生成技术

A Survey of Body and Face Motion: Datasets, Performance Evaluation Metrics and Generative Techniques

Indian Institute of Technology Ropar(印度理工学院罗帕尔);Monash University(莫纳什大学)

Lownish Rai Sookha, Nikhil Pakhale, Mudasir Ganaie, Abhinav Dhall

AI总结:

本文综述了人体和面部运动生成,涵盖数据集、评估指标和生成技术,首次全面探讨了该领域的发展与未来方向。

摘要:

人体和面部运动在交流中起着关键作用。它们传达了参与者的重要信息。生成模型和多模态学习的进步使得从语音、对话上下文和视觉线索等信号中生成运动成为可能。然而,生成表达性强且连贯的人体和面部动态仍然具有挑战性,因为这涉及言语/非言语线索的复杂相互作用以及个体性格特征。本文综述了人体和面部运动生成,涵盖了核心概念、表示技术、生成方法、数据集和评估指标。我们强调了未来方向,以提高双人设置中仿真的现实感、连贯性和表达性。据我们所知,这项工作是首次全面综述,涵盖了人体和面部运动。详细资源列于https://lownish23csz0010.github.io/mogen/。

英文摘要:

Body and face motion play an integral role in communication. They convey crucial information on the participants. Advances in generative modeling and multi-modal learning have enabled motion generation from signals such as speech, conversational context and visual cues. However, generating expressive and coherent face and body dynamics remains challenging due to the complex interplay of verbal / non-verbal cues and individual personality traits. This survey reviews body and face motion generation, covering core concepts, representations techniques, generative approaches, datasets and evaluation metrics. We highlight future directions to enhance the realism, coherence and expressiveness of avatars in dyadic settings. To the best of our knowledge, this work is the first comprehensive review to cover both body and face motion. Detailed resources are listed on https://lownish23csz0010.github.io/mogen/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑