arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.17437cs.CVcs.LGcs.NE
收藏

无帧序列约束的手语识别:阿根廷手语的概念验证

Sign Languague Recognition without frame-sequencing constraints: A proof of concept on the Argentinian Sign Language

Instituto de Investigación en Informática LIDI, Facultad de informática, Universidad Nacional de La Plata(拉普拉塔国立大学信息学院LIDI信息学研究所);Instituto Superior Politécnico Jose Antonio Echeverría(何塞·安东尼奥·埃切维里亚高等理工学院)

Franco Ronchetti, Facundo Manuel Quiroga, César Estrebou, Laura Lanzarini, Alejandro Rosete

AI总结:

本文提出一种基于词袋方法并结合位置、运动与手形特征子分类器的通用概率手语识别模型,在阿根廷手语64类3200样本上取得97%准确率,证明无帧序列约束的识别可行。

摘要:

自动手语识别(SLR)是人机交互和机器学习领域中的一个重要课题。一方面,它构成了一项复杂的挑战,需要视频处理、图像处理、智能系统和语言学等多个知识领域的介入。另一方面,鲁棒的手语识别可以辅助翻译过程、促进听障人士的社会融入,以及面向健听人群开展手语教学。SLR系统通常采用隐马尔可夫模型、动态时间规整或类似模型来识别手语。这些技术利用帧的序列顺序来减少假设数量。本文提出了一种用于手语分类的通用概率模型,该模型结合了基于位置、运动和手形等不同类型特征的子分类器。该模型在所有分类步骤中采用词袋方法,以探索“顺序对于识别并非必不可少”这一假设。所提出的模型在包含64个手语类别和3200个样本的阿根廷手语数据集上取得了97%的准确率,为“无需顺序信息即可进行识别”提供了若干证据。

英文摘要:

Automatic sign language recognition (SLR) is an important topic within the areas of human-computer interaction and machine learning. On the one hand, it poses a complex challenge that requires the intervention of various knowledge areas, such as video processing, image processing, intelligent systems and linguistics. On the other hand, robust recognition of sign language could assist in the translation process and the integration of hearing-impaired people, as well as the teaching of sign language for the hearing population. SLR systems usually employ Hidden Markov Models, Dynamic Time Warping or similar models to recognize signs. Such techniques exploit the sequential ordering of frames to reduce the number of hypothesis. This paper presents a general probabilistic model for sign classification that combines sub-classifiers based on different types of features such as position, movement and handshape. The model employs a bag-of-words approach in all classification steps, to explore the hypothesis that ordering is not essential for recognition. The proposed model achieved an accuracy rate of 97% on an Argentinian Sign Language dataset containing 64 classes of signs and 3200 samples, providing some evidence that indeed recognition without ordering is possible.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑