arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.06702cs.CLcs.CV
收藏

基于微调YOLOv8与计算机视觉技术的马拉雅拉姆语手语识别

Malayalam Sign Language Identification using Finetuned YOLOv8 and Computer Vision Techniques

School of Digital Sciences(数字科学学院)

Abhinand K., Abhiram B. Nair, Dhananjay C., Hanan Hamza, Mohammed Fawaz J., Rahma Fahim K., Anoop V. S

AI总结:

针对马拉雅拉姆语手语数据缺失、听障群体适配工具不足的问题,本文构建标注数据集,结合YOLOv8与计算机视觉技术实现手语识别,准确率达可比水平,可作为领域研究基线。

摘要:

技术进步与创新正从方方面面改善我们的日常生活,但社会中有相当一部分群体因身体残障无法享受到这些便利。为了让技术真正惠及大众,这些有才华、有天赋的群体也应当能毫无障碍地使用这类创新成果。如今已有不少应用旨在应对这些挑战,但本地化社群及其他受限语言群体可能仍难以使用它们。马拉雅拉姆语是印度喀拉拉邦使用的一种达罗毗荼语系语言,也是印度22种官方语言之一。近年来,针对喀拉拉邦需求的马拉雅拉姆语系统与工具开发热度上升,但其中多数并未充分考虑听障群体的需求。核心挑战之一在于马拉雅拉姆语的手语数据十分有限甚至完全缺失,且该方向尚未投入足够的研究努力。针对这一问题,本文提出一种利用先进深度学习与计算机视觉技术实现马拉雅拉姆语手语识别的方法。我们首先构建了一个包含马拉雅拉姆语字母的标注数据集,随后采用YOLOv8等先进深度学习技术结合计算机视觉方法完成识别任务。实验结果表明,该方法的识别准确率与其他手语识别系统相当,相关领域的研究人员可将该模型作为基线,开发更先进的手语识别模型。

英文摘要:

Technological advancements and innovations are advancing our daily life in all the ways possible but there is a larger section of society who are deprived of accessing the benefits due to their physical inabilities. To reap the real benefits and make it accessible to society, these talented and gifted people should also use such innovations without any hurdles. Many applications developed these days address these challenges, but localized communities and other constrained linguistic groups may find it difficult to use them. Malayalam, a Dravidian language spoken in the Indian state of Kerala is one of the twenty-two scheduled languages in India. Recent years have witnessed a surge in the development of systems and tools in Malayalam, addressing the needs of Kerala, but many of them are not empathetically designed to cater to the needs of hearing-impaired people. One of the major challenges is the limited or no availability of sign language data for the Malayalam language and sufficient efforts are not made in this direction. In this connection, this paper proposes an approach for sign language identification for the Malayalam language using advanced deep learning and computer vision techniques. We start by developing a labeled dataset for Malayalam letters and for the identification we use advanced deep learning techniques such as YOLOv8 and computer vision. Experimental results show that the identification accuracy is comparable to other sign language identification systems and other researchers in sign language identification can use the model as a baseline to develop advanced models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑