Diacritics (short vowels) are typically omitted when writing Arabic text, and readers have to reintroduce them to correctly pronounce words. There are two types of Arabic diacritics: the first are core-word diacritics (CW), which specify the lexical selection, and the second are case endings (CE), which typically appear at the end of the word stem and generally specify their syntactic roles. Recovering CEs is relatively harder than recovering core-word diacritics due to inter-word dependencies, which are often distant. In this paper, we use a feature-rich recurrent neural network model that uses a variety of linguistic and surface-level features to recover both core word diacritics and case endings. Our model surpasses all previous state-of-the-art systems with a CW error rate (CWER) of 2.86\% and a CE error rate (CEER) of 3.7% for Modern Standard Arabic (MSA) and CWER of 2.2% and CEER of 2.5% for Classical Arabic (CA). When combining diacritized word cores with case endings, the resultant word error rate is 6.0% and 4.3% for MSA and CA respectively. This highlights the effectiveness of feature engineering for such deep neural models.
An End-to-End OCR Framework for Robust Arabic-Handwriting Recognition using a Novel Transformers-based Model and an Innovative 270 Million-Words Multi-Font Corpus of Classical Arabic with Diacritics
Efficient Convolutional Neural Networks for Diacritic Restoration
AWS, Amazon AI(亚马逊人工智能 AWS);The George Washington University(乔治华盛顿大学);Princess Nourah Bint Abdul Rahman University(诺拉·宾特·阿卜杜勒拉赫曼公主大学)
随着机器理解书面文本的需求不断增长,变音符号恢复变得越来越重要。该任务通常被建模为序列标记问题,目前双向长短期记忆(BiLSTM)模型提供了最先进的结果。最近,Bai et al.(2018)展示了时间卷积神经网络(TCN)在性能和计算资源方面优于递归神经网络(RNN)的序列建模优势。由于变音恢复的好处,从以前的以及随后的时间步,我们进一步应用和评估的TCN的一个变种,tuminusal TCN(A-TCN),它结合了上下文中的两个方向(以前和未来),而不是严格纳入以前的上下文的情况下,TCN。A-TCN在三种不同语言(阿拉伯语、约鲁巴语和越南语)的变音符号化方面比TCN有显著的改进。此外,A-TCN和BiLSTM具有相当的性能,使A-TCN成为BiLSTM的有效替代方案,因为卷积可以并行训练。A-TCN在推理时间上明显快于BiLSTM(每分钟变音文本量提高了270%-334%)。