arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.12369cs.CLcs.CV
收藏

连续手语识别技术的比较研究

A Comparative Study of Continuous Sign Language Recognition Techniques

Applied College, Imam Abdulrahman Bin Faisal University(伊玛目阿卜杜勒拉赫曼·本·费萨尔大学应用学院);King Fahd University of Petroleum and Minerals(法赫德国王石油与矿产大学);SDAIA-KFUPM Joint Research Center for Artificial Intelligence(沙特数据与人工智能总局-法赫德国王石油与矿产大学人工智能联合研究中心)

Sarah Alyami, Hamzah Luqman

AI总结:

本文实证比较了多种深度学习连续手语识别技术,在 RWTH-PHOENIX-Weather-2014、ArabSign 和 GrSL 三个数据集上评估其对不同手语的建模能力、鲁棒性和泛化性,并建立了新的基准。

摘要:

连续手语识别(CSLR)专注于解释一系列连续执行、无停顿的手语手势。在本研究中,我们对近期基于深度学习的连续手语识别技术进行了实证评估,并考察它们在多种数据集和不同手语上的表现。被选取分析的模型采用了一系列不同的方法来提取有意义的特征,并使用了不同的训练策略。为了确定这些模型在建模不同手语方面的有效性,我们使用多个数据集对它们进行了评估,具体包括 RWTH-PHOENIX-Weather-2014、ArabSign 和 GrSL,每个数据集代表一种独特的手语。这些模型的性能还进一步在未见过的打手和句子上进行了测试。所进行的实验在所选数据集上建立了新的基准,并为所评估技术在具有挑战性的场景下的鲁棒性和泛化能力提供了有价值的见解。

英文摘要:

Continuous Sign Language Recognition (CSLR) focuses on the interpretation of a sequence of sign language gestures performed continually without pauses. In this study, we conduct an empirical evaluation of recent deep learning CSLR techniques and assess their performance across various datasets and sign languages. The models selected for analysis implement a range of approaches for extracting meaningful features and employ distinct training strategies. To determine their efficacy in modeling different sign languages, these models were evaluated using multiple datasets, specifically RWTH-PHOENIX-Weather-2014, ArabSign, and GrSL, each representing a unique sign language. The performance of the models was further tested with unseen signers and sentences. The conducted experiments establish new benchmarks on the selected datasets and provide valuable insights into the robustness and generalization of the evaluated techniques under challenging scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑