arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.16596cs.CL
收藏

追踪斯洛文尼亚语中的语义变化:一个新颖的数据集与基于最优传输的距离

Tracking Semantic Change in Slovene: A Novel Dataset and Optimal Transport-Based Distance

Jožef Stefan Institute(乔泽夫·斯塔芬研究所);Jožef Stefan International Postgraduate School(乔泽夫·斯塔芬国际研究生学院);University of Ljubljana(卢布尔雅那大学)

Marko Pranjić, Kaja Dobrovoljc, Senja Pollak, Matej Martinc

AI总结:

本文针对斯洛文尼亚语提出首个语义变化检测数据集,并发现基于平均成对距离的度量存在局限,进而提出基于正则化最优传输的新度量,实证表明其性能优于基线方法。

摘要:

本文专注于检测斯洛文尼亚语(一种拥有两百万使用者的低资源斯拉夫语)中的语义变化。检测和追踪语义变化能为了解由社会与文化变迁引发的语言演变提供洞见。我们提出了首个用于评估语义变化检测系统的斯洛文尼亚语数据集,该数据集包含从超过3000个手动标注的句子对中获取的104个目标词的聚合语义变化分数。我们分析了基于平均成对距离的重要语义变化度量类别,并识别出若干局限性。为解决这些局限性,我们提出了一种基于正则化最优传输的新颖度量,为量化语义变化提供了更稳健的框架。我们在数据集上对各种现有的语义变化检测方法及相关度量进行了全面评估。通过实证测试,我们证明利用正则化最优传输的提出方法,相较于基线方法取得了相当或更优的性能。

英文摘要:

In this paper, we focus on the detection of semantic changes in Slovene, a less resourced Slavic language with two million speakers. Detecting and tracking semantic changes provides insight into the evolution of language caused by changes in society and culture. We present the first Slovene dataset for evaluating semantic change detection systems, which contains aggregated semantic change scores for 104 target words obtained from more than 3,000 manually annotated sentence pairs. We analyze an important class of measures of semantic change metrics based on the Average pairwise distance and identify several limitations. To address these limitations, we propose a novel metric based on regularized optimal transport, which offers a more robust framework for quantifying semantic change. We provide a comprehensive evaluation of various existing semantic change detection methods and associated semantic change measures on our dataset. Through empirical testing, we demonstrate that our proposed approach, leveraging regularized optimal transport, achieves either matching or improved performance compared to baseline approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑