LSA-T:第一个连续的阿根廷手语数据集,用于手语翻译
LSA-T: The first continuous Argentinian Sign Language dataset for Sign Language Translation
摘要:
手语翻译是一个活跃的研究领域,包括人机交互,计算机视觉,自然语言处理和机器学习。这一领域的进展可能导致聋人更高程度的融入社会。本文介绍了,据我们所知,第一个连续的阿根廷手语(LSA)数据集。它包含从CN Sordos YouTube频道提取的14,880个句子级别的LSA视频,每个签名者都有标签和关键点注释。我们还提出了一种方法,用于推断的主动签名者,数据集的特性的详细分析,一个可视化工具,以探索数据集和神经网络模型作为基线,为未来的实验。
英文摘要:
Sign language translation (SLT) is an active field of study that encompasses human-computer interaction, computer vision, natural language processing and machine learning. Progress on this field could lead to higher levels of integration of deaf people. This paper presents, to the best of our knowledge, the first continuous Argentinian Sign Language (LSA) dataset. It contains 14,880 sentence level videos of LSA extracted from the CN Sordos YouTube channel with labels and keypoints annotations for each signer. We also present a method for inferring the active signer, a detailed analysis of the characteristics of the dataset, a visualization tool to explore the dataset and a neural SLT model to serve as baseline for future experiments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。