arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1609.07681cs.CL
收藏

英语句子中信息量的分布

The distribution of information content in English sentences

Communication University of China(中国传媒大学);Zhejiang University(浙江大学)

Shuiyuan Yu, Jin Cong, Junying Liang, Haitao Liu

摘要:

句子是一种基本的语言单位,然而人们对句子中不同位置的信息量分布情况却知之甚少。基于真实的英语语料,本研究计算了不同句子位置的熵和其他与熵相关的统计量。统计数据表明,三步楼梯形分布模式,与熵在初始位置低于中间位置(位置以外的初始和最终),中间位置低于最终位置和中间位置显示没有显着差异。结果表明:(1)在句中位置上,熵率恒定假设和信息密度均匀假设不成立;(2)句中词的语境不能简单地定义为同一句中所有在它前面的词;(3)句中的语境信息量不是递增的,而是遵循“整体大于部分之和”的规律。

英文摘要:

Sentence is a basic linguistic unit, however, little is known about how information content is distributed across different positions of a sentence. Based on authentic language data of English, the present study calculated the entropy and other entropy-related statistics for different sentence positions. The statistics indicate a three-step staircase-shaped distribution pattern, with entropy in the initial position lower than the medial positions (positions other than the initial and final), the medial positions lower than the final position and the medial positions showing no significant difference. The results suggest that: (1) the hypotheses of Constant Entropy Rate and Uniform Information Density do not hold for the sentence-medial positions; (2) the context of a word in a sentence should not be simply defined as all the words preceding it in the same sentence; and (3) the contextual information content in a sentence does not accumulate incrementally but follows a pattern of "the whole is greater than the sum of parts".

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑