Idiom detection using Natural Language Processing (NLP) is the computerized process of recognizing figurative expressions within a text that convey meanings beyond the literal interpretation of the words. While idiom detection has seen significant progress across various languages, the Kurdish language faces a considerable research gap in this area despite the importance of idioms in tasks like machine translation and sentiment analysis. This study addresses idiom detection in Sorani Kurdish by approaching it as a text classification task using deep learning techniques. To tackle this, we developed a dataset containing 10,580 sentences embedding 101 Sorani Kurdish idioms across diverse contexts. Using this dataset, we developed and evaluated three deep learning models: KuBERT-based transformer sequence classification, a Recurrent Convolutional Neural Network (RCNN), and a BiLSTM model with an attention mechanism. The evaluations revealed that the transformer model, the fine-tuned BERT, consistently outperformed the others, achieving nearly 99% accuracy while the RCNN achieved 96.5% and the BiLSTM 80%. These results highlight the effectiveness of Transformer-based architectures in low-resource languages like Kurdish. This research provides a dataset, three optimized models, and insights into idiom detection, laying a foundation for advancing Kurdish NLP.
Part of Speech Tagging (POST) of a Low-resource Language using another Language (Developing a POS-Tagged Lexicon for Kurdish (Sorani) using a Tagged Persian (Farsi) Corpus)
Leveraging Multilingual News Websites for Building a Kurdish Parallel Corpus
Insight Centre for Data Analytics(数据 analytics 洞察中心);National University of Ireland Galway(爱尔兰国立高威大学);University of Kurdistan Hewlêr(埃尔比勒库尔德斯坦大学);Koya University(科亚大学)
The Role of Orthographic Consistency in Multilingual Embedding Models for Text Classification in Arabic-Script Languages
University of Kurdistan Hewler(库尔德斯坦赫勒大学);Soran University(索兰大学);University of Technology Sydney(悉尼科技大学);Torrens University Australia(澳大利亚托伦斯大学);Sunway University Malaysia(马来西亚双威大学);University of Kragujevac(克拉古耶瓦茨大学);University of Tehran(德黑兰大学)