arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1906.05906cs.CL
收藏

从意义到形式:作为信息的系统性测量

Meaning to Form: Measuring Systematicity as Information

Kunumi(Kunumi公司);Johns Hopkins University(约翰斯·霍普金斯大学);University of Zürich(苏黎世大学);MPI SHH(马克斯·普朗克人类历史科学研究所);Google(谷歌);University of Cambridge(剑桥大学)

Tiago Pimentel, Arya D. McCarthy, Damián E. Blasi, Brian Roark, Ryan Cotterell

摘要:

语言符号与语义之间的关系是符号学长期争论的焦点:词形与语义之间是任意的关系,还是存在系统的现象?例如,字符二元组\textit{gl}与诸如\textit{glisten}、\textit{gleam}和\textit{glow}之类的单词的含义有任何系统的关系吗?在这项工作中,我们提供了一个整体量化的系统性的标志使用互信息和递归神经网络。我们采用数据驱动和大规模多语言的方法来解决这个问题,检查106种语言。我们发现一个统计上显着的熵减少时,其语义表示条件的单词形式建模。令人鼓舞的是,我们也恢复了良好的证明英语系统词缀的例子。我们的结论与元点:我们的近似效果大小(以位为单位)是相当小的-尽管形式和意义之间有一定的系统性,一个任意的关系及其产生的好处主导着人类语言。

英文摘要:

A longstanding debate in semiotics centers on the relationship between linguistic signs and their corresponding semantics: is there an arbitrary relationship between a word form and its meaning, or does some systematic phenomenon pervade? For instance, does the character bigram \textit{gl} have any systematic relationship to the meaning of words like \textit{glisten}, \textit{gleam} and \textit{glow}? In this work, we offer a holistic quantification of the systematicity of the sign using mutual information and recurrent neural networks. We employ these in a data-driven and massively multilingual approach to the question, examining 106 languages. We find a statistically significant reduction in entropy when modeling a word form conditioned on its semantic representation. Encouragingly, we also recover well-attested English examples of systematic affixes. We conclude with the meta-point: Our approximate effect size (measured in bits) is quite small---despite some amount of systematicity between form and meaning, an arbitrary relationship and its resulting benefits dominate human language.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑