濒危语言记录语境下语素标注的鲁棒泛化策略
Robust Generalization Strategies for Morpheme Glossing in an Endangered Language Documentation Context
AI总结:
针对濒危语言 Uspanteko 语素标注中的跨体裁泛化问题,本文结合权重衰减、输出去噪与迭代伪标注,将未见体裁测试集性能提升2%。
摘要:
在资源受限的环境中,泛化尤为重要,因为可用训练数据可能仅占可能文本分布的一小部分。我们通过评估语素标注模型在未见文本体裁上的表现来研究其泛化能力,并试验了用于缩小分布内与分布外数据性能差距的策略。具体而言,我们采用权重衰减优化、输出去噪和迭代伪标注,并在包含来自未见体裁文本的测试集上实现了2%的提升。所有实验均使用以玛雅语言 Uspanteko 书写的文本完成。
英文摘要:
Generalization is of particular importance in resource-constrained settings, where the available training data may represent only a small fraction of the distribution of possible texts. We investigate the ability of morpheme labeling models to generalize by evaluating their performance on unseen genres of text, and we experiment with strategies for closing the gap between performance on in-distribution and out-of-distribution data. Specifically, we use weight decay optimization, output denoising, and iterative pseudo-labeling, and achieve a 2% improvement on a test set containing texts from unseen genres. All experiments are performed using texts written in the Mayan language Uspanteko.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。