arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1707.04790cs.HC
收藏

无意义身体运动的自动识别及其对人类的启示

Automatic Identification of Non-Meaningful Body-Movements and What It Reveals About Humans

Md Iftekhar Tanveer, RuJie Zhao, Mohammed Hoque

摘要:

我们提出了一个框架,以确定是否一个公开演讲者的身体动作是有意义的或无意义的(“矫揉造作”),在他们的演讲。在来自28个人的84个公开演讲视频的数据集中,我们提取了314个独特的身体运动模式(例如,步伐,手势,体重变化等)。在线工作人员和演讲者自己注释了这些模式的意义。我们从音频视频记录中提取了五种类型的特征:不流利,韵律,身体动作,面部和词汇。我们使用线性分类器来预测AUC高达0.82的注释。分类器的权重分析表明,它把更大的权重的词汇特征,同时预测自我注释。相比之下,它把一个更大的重量韵律功能,同时预测观众注释。这一分析可能提供了一个微妙的暗示,即公众演讲者在评价自我表演时往往更关注言语特征。另一方面,听众往往更关注演讲的非语言方面。与这项工作相关的数据集和代码已发布供同行评审和进一步分析。

英文摘要:

We present a framework to identify whether a public speaker's body movements are meaningful or non-meaningful ("Mannerisms") in the context of their speeches. In a dataset of 84 public speaking videos from 28 individuals, we extract 314 unique body movement patterns (e.g. pacing, gesturing, shifting body weights, etc.). Online workers and the speakers themselves annotated the meaningfulness of the patterns. We extracted five types of features from the audio-video recordings: disfluency, prosody, body movements, facial, and lexical. We use linear classifiers to predict the annotations with AUC up to 0.82. Analysis of the classifier weights reveals that it puts larger weights on the lexical features while predicting self-annotations. Contrastingly, it puts a larger weight on prosody features while predicting audience annotations. This analysis might provide subtle hint that public speakers tend to focus more on the verbal features while evaluating self-performances. The audience, on the other hand, tends to focus more on the non-verbal aspects of the speech. The dataset and code associated with this work has been released for peer review and further analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑