CKMorph：一个中央库尔德语的综合形态分析器
CKMorph: A Comprehensive Morphological Analyzer for Central Kurdish
摘要：
形态分析器是许多自然语言处理应用的重要组成部分，特别是对于形态丰富的语言，它将输入的单词划分为所有组成词素并识别它们的形态角色。在本文中，我们介绍了一个全面的形态分析器中央库尔德语（CK），一个低资源的语言与丰富的形态。在有限的现有文献的基础上，我们首先组装和系统地分类了一个全面的收集形态和形态音位规则的语言。此外，我们收集并手动标记了一个生成词典，其中包含近10，000个动词，名词和形容词词干，命名实体和其他类型的词干。我们使用这些规则集和资源来实现基于有限状态转换器的CKMorph Analyzer。为了为未来的研究提供基准，我们收集，手动标记，并公开共享测试集，以评估分析仪的准确性和覆盖率。CKMorph能够正确分析95.9%的准确率测试集，包含根据上下文进行形态分析的1，000个CK单词。此外，CKMorph对覆盖测试集的422万个CK标记中的95.5%给出了至少一个分析。该应用程序的演示和资源，包括CK动词数据库和测试集，可在https://github.com/CKMorph上公开访问。
英文摘要：
A morphological analyzer, which is a significant component of many natural language processing applications especially for morphologically rich languages, divides an input word into all its composing morphemes and identifies their morphological roles. In this paper, we introduce a comprehensive morphological analyzer for Central Kurdish (CK), a low-resourced language with a rich morphology. Building upon the limited existing literature, we first assembled and systematically categorized a comprehensive collection of the morphological and morphophonological rules of the language. Additionally, we collected and manually labeled a generative lexicon containing nearly 10,000 verb, noun and adjective stems, named entities, and other types of word stems. We used these rule sets and resources to implement CKMorph Analyzer based on finite-state transducers. In order to provide a benchmark for future research, we collected, manually labeled, and publicly shared test sets for evaluating accuracy and coverage of the analyzer. CKMorph was able to correctly analyze 95.9% of the accuracy test set, containing 1,000 CK words morphologically analyzed according to the context. Moreover, CKMorph gave at least one analysis for 95.5% of 4.22M CK tokens of the coverage test set. The demonstration of the application and resources including CK verb database and test sets are openly accessible at https://github.com/CKMorph.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
