Segmentation is a fundamental step for most Natural Language Processing tasks. The Kurdish language is a multi-dialect, under-resourced language which is written in different scripts. The lack of various segmented corpora is one of the major bottlenecks in Kurdish language processing. We used Punkt, an unsupervised machine learning method, to segment a Kurdish corpus of Sorani dialect, written in Persian-Arabic script. According to the literature, studies on using Punkt on non-Latin data are scanty. In our experiment, we achieved an F1 score of 91.10% and had an Error Rate of 16.32%. The high Error Rate is mainly due to the situation of abbreviations in Kurdish and partly because of ordinal numerals. The data is publicly available at https://github.com/KurdishBLARK/ KTC-Segmented for non-commercial use under the CC BY-NC-SA 4.0 licence.
Part of Speech Tagging (POST) of a Low-resource Language using another Language (Developing a POS-Tagged Lexicon for Kurdish (Sorani) using a Tagged Persian (Farsi) Corpus)
Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus
Insight Centre for Data Analytics(数据 analytics 洞察中心);National University of Ireland Galway(爱尔兰国立高威大学);University of Kurdistan Hewlêr(埃尔比勒库尔德斯坦大学);Koya University(科亚大学)
From Dialect Gaps to Identity Maps: Tackling Variability in Speaker Verification
Artificial Intelligence and Innovation Centre, University of Kurdistan Hewlér(库尔德斯坦赫威勒大学人工智能与创新中心);Language Center, Charmo University(查尔莫大学语言中心);Faculty of Engineering and Computer Science, Qaiwan International University(凯万国际大学工程与计算机科学学院);Computer Science Department, Faculty of Science, Soran University(索兰大学理学院计算机科学系)
The Role of Orthographic Consistency in Multilingual Embedding Models for Text Classification in Arabic-Script Languages
University of Kurdistan Hewler(库尔德斯坦赫勒大学);Soran University(索兰大学);University of Technology Sydney(悉尼科技大学);Torrens University Australia(澳大利亚托伦斯大学);Sunway University Malaysia(马来西亚双威大学);University of Kragujevac(克拉古耶瓦茨大学);University of Tehran(德黑兰大学)