Meta书与书面语言的大小依赖性
The meta book and size-dependent properties of written language
摘要:
证据是一个系统的文本长度依赖的幂律指数伽玛的一本书。所估计的伽马值与随着文本长度的增加从2到1的单调减小一致。一个直接连接到一个扩展堆的法律进行了探讨。因此,如果齐普夫定律普遍适用,那么无限的账面限额将由伽马= 1而不是预期的伽马=2给出。此外,我们探讨的想法,系统的文本长度依赖可以描述的Meta书的概念,这是一个抽象的表示反映词频结构的文本。根据这一概念,由单个作者撰写的具有一定长度的文本的词频分布与从同一作者撰写的想象的完整无限语料库中提取的相同长度的文本具有相同的特征。
英文摘要:
Evidence is given for a systematic text-length dependence of the power-law index gamma of a single book. The estimated gamma values are consistent with a monotonic decrease from 2 to 1 with increasing length of a text. A direct connection to an extended Heap's law is explored. The infinite book limit is, as a consequence, proposed to be given by gamma = 1 instead of the value gamma=2 expected if the Zipf's law was ubiquitously applicable. In addition we explore the idea that the systematic text-length dependence can be described by a meta book concept, which is an abstract representation reflecting the word-frequency structure of a text. According to this concept the word-frequency distribution of a text, with a certain length written by a single author, has the same characteristics as a text of the same length pulled out from an imaginary complete infinite corpus written by the same author.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。