arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.03484cs.CL
收藏

Synthetic Error Dataset Generation Mimicking Bengali Writing Pattern

United International University(联合国际大学)

Md. Habibur Rahman Sifat, Chowdhury Rafeed Rahman, Mohammad Rafsan, Md. Hasibur Rahman

英文摘要:

While writing Bengali using English keyboard, users often make spelling mistakes. The accuracy of any Bengali spell checker or paragraph correction module largely depends on the kind of error dataset it is based on. Manual generation of such error dataset is a cumbersome process. In this research, We present an algorithm for automatic misspelled Bengali word generation from correct word through analyzing Bengali writing pattern using QWERTY layout English keyboard. As part of our analysis, we have formed a list of most commonly used Bengali words, phonetically similar replaceable clusters, frequently mispressed replaceable clusters, frequently mispressed insertion prone clusters and some rules for Juktakkhar (constant letter clusters) handling while generating errors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑