arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2103.03130cs.HC
收藏

这是一场比赛!基于表情参数匹配的手势生成

It's A Match! Gesture Generation Using Expressive Parameter Matching

Ylva Ferstl, Michael Neff, Rachel McDonnell

摘要:

从语音的自动手势生成通常依赖于非确定性语音-手势关系的隐式建模,并且可能导致缺乏定义形式的平均运动。在这里,我们提出了一个数据库驱动的方法,选择手势的基础上,已被证明是与语音音频的特定运动特征。我们扩展了以前的工作,确定表达的手势运动参数,既可以从语音预测,是一个很好的语音手势匹配,如手势速度和手指延伸感知重要。一个感性的研究进行评估的适当性的手势选择与我们的方法。我们比较我们的方法与两个基线选择方法。第一个方面的时机,期望的开始和持续时间的手势,但不匹配的手势形式在其他方面。第二基线另外忽略用于选择手势的原始手势定时。从我们的方法的手势序列被评为一个显着更好的匹配的语音比手势选择的基线方法。

英文摘要:

Automatic gesture generation from speech generally relies on implicit modelling of the nondeterministic speech-gesture relationship and can result in averaged motion lacking defined form. Here, we propose a database-driven approach of selecting gestures based on specific motion characteristics that have been shown to be associated with the speech audio. We extend previous work that identified expressive parameters of gesture motion that can both be predicted from speech and are perceptually important for a good speech-gesture match, such as gesture velocity and finger extension. A perceptual study was performed to evaluate the appropriateness of the gestures selected with our method. We compare our method with two baseline selection methods. The first respects timing, the desired onset and duration of a gesture, but does not match gesture form in other ways. The second baseline additionally disregards the original gesture timing for selecting gestures. The gesture sequences from our method were rated as a significantly better match to the speech than gestures selected by either baseline method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑