arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.14256cs.CL

句子嵌入的线性跨语言映射

Linear Cross-Lingual Mapping of Sentence Embeddings

Primer Technologies Inc.(普里默技术公司)

Oleg Vasilyev, Fumika Isono, John Bohannon

AI总结:

本文假设句子语义在翻译中应更好保留,提出利用简单的线性跨语言映射改进多语言句子嵌入,并将偏离正交条件的程度作为嵌入缺陷的度量。

摘要:

句子的语义比单个词的语义具有更少的歧义,我们假设它通过翻译成另一种语言应得到更好的保留。如果多语言句子嵌入旨在表示句子语义,那么任意两个句子的嵌入之间的相似度必须对翻译保持不变。基于这一建议,我们将简单的线性跨语言映射视为多语言嵌入的一种可能改进。我们还考虑将偏离正交条件的程度作为嵌入缺陷的度量。

英文摘要:

Semantics of a sentence is defined with much less ambiguity than semantics of a single word, and we assume that it should be better preserved by translation to another language. If multilingual sentence embeddings intend to represent sentence semantics, then the similarity between embeddings of any two sentences must be invariant with respect to translation. Based on this suggestion, we consider a simple linear cross-lingual mapping as a possible improvement of the multilingual embeddings. We also consider deviation from orthogonality conditions as a measure of deficiency of the embeddings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑