VSEC:基于转换器的越南语拼写纠正模型
VSEC: Transformer-based Model for Vietnamese Spelling Correction
摘要:
拼写纠错是自然语言处理中一个历史悠久的课题。虽然以往的研究取得了显著的成果,但挑战仍然存在。在越南语中,一种最先进的任务方法是从相邻的音节推断音节的上下文。然而,该方法的准确性可能不令人满意,因为如果两个(或更多)拼写错误彼此靠近,则模型可能会丢失上下文。在本文中,我们提出了一种新的方法来纠正越南语拼写错误。我们通过使用深度学习模型来解决打字错误和拼写错误的问题。嵌入层特别是由字节对编码技术提供动力。基于Transformer体系结构的序列到序列模型使得我们的方法不同于以前对同一问题的研究。在实验中,我们用一个大的合成数据集来训练模型,这个数据集是随机引入拼写错误的。我们使用一个现实的数据集测试所提出的方法的性能。该数据集包含9,341个不同越南语句子中的11,202个人为拼写错误。实验结果表明,我们的方法取得了令人鼓舞的性能与86.8%的错误检测和81.5%的错误纠正,提高了国家的最先进的方法5.6%和2.2%,分别。
英文摘要:
Spelling error correction is one of topics which have a long history in natural language processing. Although previous studies have achieved remarkable results, challenges still exist. In the Vietnamese language, a state-of-the-art method for the task infers a syllable's context from its adjacent syllables. The method's accuracy can be unsatisfactory, however, because the model may lose the context if two (or more) spelling mistakes stand near each other. In this paper, we propose a novel method to correct Vietnamese spelling errors. We tackle the problems of mistyped errors and misspelled errors by using a deep learning model. The embedding layer, in particular, is powered by the byte pair encoding technique. The sequence to sequence model based on the Transformer architecture makes our approach different from the previous works on the same problem. In the experiment, we train the model with a large synthetic dataset, which is randomly introduced spelling errors. We test the performance of the proposed method using a realistic dataset. This dataset contains 11,202 human-made misspellings in 9,341 different Vietnamese sentences. The experimental results show that our method achieves encouraging performance with 86.8% errors detected and 81.5% errors corrected, which improves the state-of-the-art approach 5.6% and 2.2%, respectively.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。