arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2205.12072cs.CLcs.CV
收藏

手语语音参数的分类

Classification of Phonological Parameters in Sign Languages

Heriot-Watt University(赫瑞-瓦特大学)

Boris Mocialov, Graham Turner, Helen Hastie

摘要:

手语者通过组合诸如手形、方向、位置、运动和非手动特征等语音参数来组成手语音素,从而实现交流。语言学研究通常将符号分解为它们的组成部分来研究手语,并且通常在视频的注释上投入大量精力。在这项工作中,我们将展示如何使用一个单一的模型来识别的目的是帮助语言注释或描述的标志识别模型的标志内的手语的个别语音参数。我们使用丹麦手语数据集“Ordbog over Dansk Tegnsprog”来使用姿势估计模型生成多个数据集,然后将其用于训练多标签快速R-CNN模型以支持多标签建模。此外,我们发现,有一个显着的相互依赖的方向和位置的语音参数之间生成的数据,我们将这种相互依赖的模型,以实现更好的性能。

英文摘要:

Signers compose sign language phonemes that enable communication by combining phonological parameters such as handshape, orientation, location, movement, and non-manual features. Linguistic research often breaks down signs into their constituent parts to study sign languages and often a lot of effort is invested into the annotation of the videos. In this work we show how a single model can be used to recognise the individual phonological parameters within sign languages with the aim of either to assist linguistic annotations or to describe the signs for the sign recognition models. We use Danish Sign Language data set `Ordbog over Dansk Tegnsprog' to generate multiple data sets using pose estimation model, which are then used for training the multi-label Fast R-CNN model to support multi-label modelling. Moreover, we show that there is a significant co-dependence between the orientation and location phonological parameters in the generated data and we incorporate this co-dependence in the model to achieve better performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑