arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0710.4516physics.soc-phcs.CLstat.ML
收藏

书面英语中字母的可预测性

The predictability of letters in written english

University of Wuppertal(伍珀塔尔大学)

Thomas Schürmann, Peter Grassberger

摘要:

我们表明,在书面英语文本中的字母的可预测性强烈地依赖于他们在单词中的位置。第一个字母通常最不容易预测。这与直觉上的概念一致,即单词是书面语言中定义良好的子单元,这些单元之间的相关性要比它们内部的相关性弱得多。这意味着单词内部每个字母的平均熵大约是第一个字母的熵的四分之一。

英文摘要:

We show that the predictability of letters in written English texts depends strongly on their position in the word. The first letters are usually the least easy to predict. This agrees with the intuitive notion that words are well defined subunits in written languages, with much weaker correlations across these units than within them. It implies that the average entropy of a letter deep inside a word is roughly 4 times smaller than the entropy of the first letter.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑