迈向四字母单词的统计力学
Toward a statistical mechanics of four letter words
AI总结:
该研究将四字母单词视为字母交互网络,用与字母成对相关性一致的最大熵模型近似其概率分布,捕捉约92%字母多信息、发现未在训练数据中的真实词,其能量景观局部极小值占书面英语所用单词近三分之二。
摘要:
我们将单词视为字母相互作用的网络,并近似该网络所处状态的概率分布。尽管直觉上英语拼写规则具有高度组合性(且任意性),但我们发现,与字母间成对相关性一致的最大熵模型能极好地近似四字母单词的完整统计特征:捕捉约92%的字母间多信息,甚至能“发现”未出现在用于估计成对相关性的数据中的真实单词。该最大熵模型在可能的单词空间上定义了一个能量景观,其局部极小值约占书面英语所用单词的三分之二。
英文摘要:
We consider words as a network of interacting letters, and approximate the probability distribution of states taken on by this network. Despite the intuition that the rules of English spelling are highly combinatorial (and arbitrary), we find that maximum entropy models consistent with pairwise correlations among letters provide a surprisingly good approximation to the full statistics of four letter words, capturing ~92% of the multi-information among letters and even "discovering" real words that were not represented in the data from which the pairwise correlations were estimated. The maximum entropy model defines an energy landscape on the space of possible words, and local minima in this landscape account for nearly two-thirds of words used in written English.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。