arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1412.2486physics.soc-phcs.CLphysics.data-an
收藏

自然通信的优化模型

Optimization models of natural communication

Universitat Politècnica de Catalunya (UPC)(加泰罗尼亚理工大学)

Ramon Ferrer-i-Cancho

摘要:

十多年前引入了一系列信息理论模型来解释Zipf词频定律的起源。该家族基于两个信息论原则的结合:形式和意义之间的互信息最大化和形式熵最小化。该家族还揭示了其他三种模式的起源:对比原则,相关的词汇学习偏见和意义频率定律。本文从心理语言学、语言学习、信息论和协同语言学的角度对信息论的两个重要组成部分,即信息论原理和将二者线性结合的能量函数进行了综述。这个线性函数的最小化与标准信息论的压缩问题有关,并且可以通过自组织来调整。

英文摘要:

A family of information theoretic models of communication was introduced more than a decade ago to explain the origins of Zipf's law for word frequencies. The family is a based on a combination of two information theoretic principles: maximization of mutual information between forms and meanings and minimization of form entropy. The family also sheds light on the origins of three other patterns: the principle of contrast, a related vocabulary learning bias and the meaning-frequency law. Here two important components of the family, namely the information theoretic principles and the energy function that combines them linearly, are reviewed from the perspective of psycholinguistics, language learning, information theory and synergetic linguistics. The minimization of this linear function is linked to the problem of compression of standard information theory and might be tuned by self-organization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑