嵌入模型以奇特的方式度量

中文摘要 AI 辅助

嵌入空间定义了语义相似性和距离的概念。我们研究这些嵌入是否反映了质量、距离、时间和体积的物理测量，这些测量具有唯一且客观的语义等价和距离概念。我们发现物理测量在嵌入空间中仅被弱建模，反而可以观察到相当奇特的测量模式。进一步分析表明，物理测量的嵌入表示受到表面字符串相似性的强烈影响，并且相似性的重新校准并不能显著改善对齐。

英文摘要

Embedding spaces define notions of semantic similarity and distance. We study whether those embeddings reflect physical measurements of mass, distance, time and volume, which admit a unique, objective notion of semantic equivalence and distance. We find that physical measurement is only weakly modeled in the embedding space, and that instead quite peculiar measurement patterns can be observed. Further analysis indicates that embedding representations of physical measurements are strongly influenced by superficial string similarity, and recalibration of similarity does not substantially improve the alignment.

发表机构

• University of Zurich（苏黎世大学）

机构由 AI 辅助整理，请以论文原文为准。