arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1410.4012cs.CV
收藏

基于二维骨架模型的数字手语在线翻译

Online interpretation of numeric sign language using 2-d skeletal model

MCKV Institute of Engineering(MCKV工程学院)

Subhadip Basu, S. Dey, K. Mukherjee, T. S. Jana

摘要:

手势是人类交流的自然方式之一。由手势产生的符号可以具有基本含义,并且具有叠加在符号的基本含义之上的附加信息。手语是一个重要的例子,沟通手势是高度结构化的,并在世界各地被广泛接受为聋哑人的沟通媒介。本文提出了一种在线识别方案,用于解释由10个基本手形符号组成的标准数字手语。网络摄像头用于捕获实时的手运动作为系统的输入。手势的基本含义是通过分析手的形状,从输入数据帧中提取的,考虑其方向,运动和位置是固定的。对输入的手形进行处理,以识别手掌结构、指尖及其相对位置以及伸出的拇指的存在。从所获取的形状信息生成二维骨架模型以表示并随后解释手势的基本含义。

英文摘要:

Gesturing is one of the natural modes of human communication. Signs produced by gestures can have a basic meaning coupled with additional information that is layered over the basic meaning of the sign. Sign language is an important example of communicative gestures that are highly structured and well accepted across the world as a communication medium for deaf and dumb. In this paper, an online recognition scheme is proposed to interpret the standard numeric sign language comprising of 10 basic hand symbols. A web camera is used to capture the real time hand movements as input to the system. The basic meaning of the hand gesture is extracted from the input data frame by analysing the shape of the hand, considering its orientation, movement and location to be fixed. The input hand shape is processed to identify the palm structure, fingertips and their relative positions and the presence of the extended thumb. A 2-dimensional skeletal model is generated from the acquired shape information to represent and subsequently interpret the basic meaning of the hand gesture.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑