arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.04750cs.CLcs.SE
收藏

面向僧伽罗语诵读障碍辅助的低资源语音驱动NLP流水线

A Low-Resource Speech-Driven NLP Pipeline for Sinhala Dyslexia Assistance

Informatics Institute of Technology(信息学技术学院);Swansea University(斯旺西大学)

Peshala Perera, Deshan Sumanathilaka

AI总结:

本研究针对低资源语言僧伽罗语的成人诵读障碍辅助需求,构建了集成Whisper、SinBERT、mT5与Mistral及gTTS的语音驱动NLP辅助系统,在数据集有限的情况下实现了0.65的整体准确率,验证了该方法的可行性与有效性。

摘要:

成人诵读障碍仍是一个研究不足、服务缺位的领域,在非英语语境中尤为突出,尽管它对个人生活和职业发展影响重大。本研究聚焦僧伽罗语这一语言无障碍工具匮乏的低资源语言,填补了这一空白。我们提出了一款专为讲僧伽罗语的成年诵读障碍患者设计的辅助系统。该系统集成了用于语音转文本的Whisper、为识别常见诵读错误而训练的开源微调僧伽罗语BERT模型SinBERT,以及用于生成修正文本的mT5与Mistral结合模型。最后,输出结果通过gTTS转回语音,形成完整的多模态反馈闭环。尽管僧伽罗语数据集有限带来了挑战,该系统仍实现了0.66的转写准确率、0.7的修正准确率,整体系统准确率达0.65。这些结果证明了该方法的可行性与有效性。最终,本研究强调了包容性自然语言处理(NLP)技术在代表性不足语言中的重要性,并展示了一种实用的解决方案。

英文摘要:

Dyslexia in adults remains an under-researched and under-served area, particularly in non-English-speaking contexts, despite its significant impact on personal and professional lives. This work addresses that gap by focusing on Sinhala, a low-resource language with limited tools for linguistic accessibility. We present an assistive system explicitly designed for Sinhala-speaking adults with dyslexia. The system integrates Whisper for speech-to-text conversion, SinBERT, an open-sourced fine-tuned BERT model trained for Sinhala to identify common dyslexic errors, and a combined mT5 and Mistral-based model to generate corrected text. Finally, the output is converted back to speech using gTTS, creating a complete multimodal feedback loop. Despite the challenges posed by limited Sinhala-language datasets, the system achieves 0.66 transcription accuracy and 0.7 correction accuracy with 0.65 overall system accuracy. These results demonstrate both the feasibility and effectiveness of the approach. Ultimately, this work highlights the importance of inclusive Natural Language Processing (NLP) technologies in underrepresented languages and showcases a practical

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑