arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.11617cs.HCcs.GRcs.MM
收藏

基于通用数据的手势生成系统的大型众包评估:2020年GENEA挑战赛

A large, crowdsourced evaluation of gesture generation systems on common data: The GENEA Challenge 2020

Taras Kucherenko, Patrik Jonell, Youngwoo Yoon, Pieter Wolfert, Gustav Eje Henter

摘要:

共语手势,即伴随着说话的手势,在人类交际中起着重要的作用。因此,自动协同语音手势生成是嵌入式对话代理(ECA)的关键支持技术,因为人类期望ECA能够进行多模式通信。对手势生成的研究正迅速转向数据驱动的方法。不幸的是,该领域的个别研究工作很难比较:没有既定的基准,每项研究都倾向于使用自己的数据集,运动可视化和评估方法。为了解决这种情况,我们发起了GENEA挑战赛,这是一个手势生成挑战赛,参与团队在一个公共数据集上构建自动手势生成系统,并使用相同的运动渲染管道在一个大型的众包用户研究中并行评估所产生的系统。由于系统之间的评估结果的差异现在完全归因于运动生成方法之间的差异,因此可以将最近的方法相互比较,以便更好地了解该领域的最新技术水平。本文报告的目的,设计,结果和影响,我们的挑战。

英文摘要:

Co-speech gestures, gestures that accompany speech, play an important role in human communication. Automatic co-speech gesture generation is thus a key enabling technology for embodied conversational agents (ECAs), since humans expect ECAs to be capable of multi-modal communication. Research into gesture generation is rapidly gravitating towards data-driven methods. Unfortunately, individual research efforts in the field are difficult to compare: there are no established benchmarks, and each study tends to use its own dataset, motion visualisation, and evaluation methodology. To address this situation, we launched the GENEA Challenge, a gesture-generation challenge wherein participating teams built automatic gesture-generation systems on a common dataset, and the resulting systems were evaluated in parallel in a large, crowdsourced user study using the same motion-rendering pipeline. Since differences in evaluation outcomes between systems now are solely attributable to differences between the motion-generation methods, this enables benchmarking recent approaches against one another in order to get a better impression of the state of the art in the field. This paper reports on the purpose, design, results, and implications of our challenge.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑