arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

东干语的形态核心:双方言有限状态模型与多体裁评估

The Morphological Core of Dungan: A Two-Dialect Finite-State Model and a Multi-Genre Evaluation

Anton M. Alekseev, Sergey I. Nikolenko

arXiv 2607.28766首次发表:更新:

发表机构

St. Petersburg Department of the Steklov Mathematical Institute, RAS; St. Petersburg State University; Kyrgyz State Technical University named after I. Razzakov(俄罗斯科学院斯特克洛夫数学研究所圣彼得堡分部; 圣彼得堡国立大学; 伊·拉扎科夫命名的吉尔吉斯斯坦国立技术大学)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

本文构建了覆盖东干语甘肃、陕西两个方言的HFST有限状态形态分析器,通过三种体裁语料评估其形态属性,明确了东干语形态的核心特征与词汇层面的研究空间。

AI 中文摘要

东干语是中亚的一种汉藏语系语言,使用基于西里尔字母的文字,语法文献中已有详细描述,但据我们所知,其实际使用中形态的量化属性从未被系统测量过。本文采用有限状态形态分析器作为测量工具,该工具基于HFST实现,覆盖两个方言群体——作为文学标准的甘肃变体和陕西变体。该模型不提供新的语法描述,而是将东干语研究积累的知识形式化,使其可在三种体裁的语料库上进行测量。得出三项结果:显性屈折形式罕见且有限:百科语体中仅9.3%的已识别词元带有显性标记,系统仅有10个范畴,级次标记几乎不存在;歧义真实但高度局部化:78.1%的词元获得单一分析,剩余歧义几乎完全集中在两个屈折词缀上,即-di(属格/进行体)和-ni(位格/将来体);语法核心实际上是封闭的,这也印证了确实需要该工具:根据语体不同,分析器无法处理的词元中,78%至95%仅因未出现在词典中,而模型故意拒绝实现的现象最多占这些失败案例的4.5%。保留语料覆盖度为80%至85%,不低于开发语料覆盖度(73%),而不含形态的词干列表已达到67.4%,因此形态贡献了5.2个百分点。东干语的开放前沿在于词汇层面。该分析器及其源代码和所有评估脚本均已公开发布。

英文摘要

Dungan, a Sinitic language of Central Asia written in a Cyrillic-based script, is described in detail in the grammatical literature, yet the quantitative properties of its morphology in actual usage have, to the best of our knowledge, never been measured systematically. This paper uses a finite-state morphological analyzer as a measuring instrument. Implemented with HFST and covering both dialect groups (the Gansu variety, which is the literary standard, and the Shaanxi variety), the model offers no new grammatical description; it formalises the knowledge accumulated in Dungan studies and makes it measurable on corpora of three genres. Three results follow. Overt inflection is rare and limited: only 9.3% of recognized tokens in the encyclopaedic register have an overt marker, the system has just ten categories, and degree marking is almost absent. Ambiguity is genuine but sharply localized: 78.1% of tokens receive a single analysis, and the residue sits almost entirely on two clitics, -di (genitive/progressive) and -ni (locative/prospective). And the grammatical core proves effectively closed, the claim the instrument is really needed for: between 78% and 95% of the tokens the analyzer fails on, depending on register, are simply absent from the lexicon, and the phenomena the model deliberately declines to implement account for at most 4.5% of those failures. Held-out coverage (80 to 85%) is no lower than development coverage (73%), while a stem list with no morphology already reaches 67.4%, so the morphology is worth 5.2 points. The open frontier of Dungan is lexical. The analyzer, its sources and every evaluation script are released openly.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑