发表机构
Guangdong Haiqixing Marine Technology Co., Ltd.（广东海启星海洋科技有限公司）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
本文提出基于预训练语言模型的三种度量框架，定量测量丹麦语、挪威语和瑞典语的语言距离，结果与历史语言学结论一致，为近亲语言距离研究提供可复现计算框架。
AI 中文摘要
在密切相关的北日耳曼语言中，语言距离的量化传统上依赖定性方法，缺乏统一的多维计算框架。基于Transformer架构的多语言预训练模型可以将不同语言的文本映射到共享向量空间，从而实现语言距离的定量测量。本文聚焦于三种北日耳曼语言——丹麦语、挪威语（书面语）和瑞典语——并提出一个基于预训练语言模型的三种度量定量框架：（1）句子级语义距离，通过计算LaBSE和mBERT编码器对平行句子的余弦相似度获得；（2）正字法碎片化率，衡量将单语BERT词表交叉应用于平行文本时的子词分词效率；（3）MLM可预测性，比较使用mBERT进行掩码语言建模时跨语言的预测置信度和熵。使用来自Tatoeba语料库的150个三语平行句三元组作为受控样本，我们在两个独立模型上获得一致的距离排序：LaBSE：丹麦语-挪威语0.012 < 挪威语-瑞典语0.016 < 丹麦语-瑞典语0.020；mBERT：丹麦语-挪威语0.016 < 挪威语-瑞典语0.045 ≈ 丹麦语-瑞典语0.046。该排序与历史语言学结论“丹麦对挪威400年统治（1380-1814年）导致书面语言高度同源”一致。三种度量——语义、正字法和可预测性——收敛于同一结论，为密切相关语言距离的定量研究提供了可复现的计算框架，原则上可扩展到印欧语系的更多语支，有待在更多语言组上验证。
英文摘要
Among closely related North Germanic languages, the quantification of language distance has traditionally relied on qualitative methods, lacking a unified multi-dimensional computational framework. Multilingual pretrained models based on the Transformer architecture can map texts from different languages into a shared vector space, enabling quantitative measurement of language distance. This paper focuses on the three North Germanic languages---Danish, Norwegian (Bokmål), and Swedish---and proposes a three-metric quantitative framework based on pretrained language models: (1)~sentence-level semantic distance, computed as cosine similarity between LaBSE and mBERT encodings of parallel sentences; (2)~orthographic fragmentation rate, measuring subword tokenization efficiency when cross-applying monolingual BERT vocabularies to parallel texts; (3)~MLM predictability, comparing prediction confidence and entropy in masked language modeling using mBERT across languages. Using 150 trilingual parallel sentence triplets from the Tatoeba corpus as controlled samples, we obtain consistent distance rankings on two independent models: LaBSE: da--no $0.012 < $ no--sv $0.016 < $ da--sv $0.020$; mBERT: da--no $0.016 < $ no--sv $0.045 \approx $ da--sv $0.046$. This ranking is consistent with the historical linguistic conclusion that ``400 years of Danish rule over Norway (1380--1814) led to highly cognate written languages.'' The three metrics---semantic, orthographic, and predictability---converge on the same conclusion, providing a reproducible computational framework for the quantitative study of distance among closely related languages, extensible in principle to more branches of the Indo-European language family, pending validation on additional language groups.
