arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1909.11023cs.CVcs.LGcs.MM
收藏

基于机器学习方法的Bharatanatyam舞蹈表演序列识别

Posture and sequence recognition for Bharatanatyam dance performances using machine learning approach

Indian Institute of Technology, Kharagpur(印度理工学院卡拉格普尔分校)

Tanwi Mallick, Partha Pratim Das, Arun Kumar Majumdar

摘要:

理解舞蹈等表演艺术的潜在语义是一项具有挑战性的任务。舞蹈本质上是多媒体的,跨越时间和空间。捕捉和分析舞蹈的多媒体内容对于保护文化遗产、构建视频推荐系统、帮助学习者使用辅导系统都是有用的。为了开发舞蹈应用程序,需要解决舞蹈分析的三个方面:1)对舞蹈视频进行分割以找到代表性的动作元素,2)对检测到的动作元素进行匹配或识别,以及3)识别通过在一定规则下组合多个动作元素而形成的舞蹈序列。本文试图解决舞蹈分析的三个基本问题,以理解舞蹈形式的潜在语义。我们的重点是印度古典舞蹈(ICD)形式被称为Bharatanatyam。由于舞蹈是由音乐驱动的,我们使用的音乐以及运动信息的关键姿态提取。接下来,我们使用机器学习以及深度学习技术来识别关键姿势。最后,舞蹈序列识别使用隐马尔可夫模型(HMM)。我们使用Kinect捕获Bharatanatyam舞蹈的多模态数据,并建立一个注释数据集,用于ICD的研究。

英文摘要:

Understanding the underlying semantics of performing arts like dance is a challenging task. Dance is multimedia in nature and spans over time as well as space. Capturing and analyzing the multimedia content of the dance is useful for the preservation of cultural heritage, to build video recommendation systems, to assist learners to use tutoring systems. To develop an application for dance, three aspects of dance analysis need to be addressed: 1) Segmentation of the dance video to find the representative action elements, 2) Matching or recognition of the detected action elements, and 3) Recognition of the dance sequences formed by combining a number of action elements under certain rules. This paper attempts to solve three fundamental problems of dance analysis for understanding the underlying semantics of dance forms. Our focus is on an Indian Classical Dance (ICD) form known as Bharatanatyam. As dance is driven by music, we use the music as well as motion information for key posture extraction. Next, we recognize the key postures using machine learning as well as deep learning techniques. Finally, the dance sequence is recognized using the Hidden Markov Model (HMM). We capture the multi-modal data of Bharatanatyam dance using Kinect and build an annotated data set for research in ICD.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑