arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2311.00541cs.CLstat.ME
收藏

嵌入式历时词义变化模型:来自古希腊语的案例研究

An Embedded Diachronic Sense Change Model with a Case Study from Ancient Greek

University of Oxford(牛津大学)

Schyan Zafar, Geoff K. Nicholls

AI总结:

本文提出 EDiSC 模型,将词嵌入融入 DiSC 生成框架,以提升古希腊语历时词义变化建模的预测、真值恢复、不确定性量化及 MCMC 采样可扩展性。

摘要:

词义会随时间变化,而词的义项也会在此过程中演变、产生或消失。对于古代语言而言,语料库通常规模较小且稀疏,因此准确建模此类变化颇具挑战,量化义项变化估计中的不确定性也随之变得重要。GASC(Genre-Aware Semantic Change,体裁感知语义变化)和 DiSC(Diachronic Sense Change,历时词义变化)是现有的生成式模型,已被用于分析古希腊语文本语料库中目标词的义项变化;它们采用无监督学习,不借助任何预训练。这些模型将给定目标词(例如“kosmos”,意为装饰、秩序或世界)的义项表示为上下文词上的分布,并将义项流行度表示为义项上的分布。模型通过马尔可夫链蒙特卡洛(MCMC)方法拟合,以衡量这些表示随时间的变化。本文介绍 EDiSC,即嵌入式 DiSC 模型,它将词嵌入与 DiSC 相结合,以提供更优的模型性能。实验表明,EDiSC 在预测准确性、真值恢复和不确定性量化方面均有提升,并在使用 MCMC 方法时表现出更好的采样效率和可扩展性。本文还讨论了拟合这些模型所面临的挑战。

英文摘要:

Word meanings change over time, and word senses evolve, emerge or die out in the process. For ancient languages, where the corpora are often small and sparse, modelling such changes accurately proves challenging, and quantifying uncertainty in sense-change estimates consequently becomes important. GASC (Genre-Aware Semantic Change) and DiSC (Diachronic Sense Change) are existing generative models that have been used to analyse sense change for target words from an ancient Greek text corpus, using unsupervised learning without the help of any pre-training. These models represent the senses of a given target word such as "kosmos" (meaning decoration, order or world) as distributions over context words, and sense prevalence as a distribution over senses. The models are fitted using Markov Chain Monte Carlo (MCMC) methods to measure temporal changes in these representations. This paper introduces EDiSC, an Embedded DiSC model, which combines word embeddings with DiSC to provide superior model performance. It is shown empirically that EDiSC offers improved predictive accuracy, ground-truth recovery and uncertainty quantification, as well as better sampling efficiency and scalability properties with MCMC methods. The challenges of fitting these models are also discussed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑