arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1607.02804stat.ME
收藏

在随机样本中估计物种数以获得足够的代表性

Estimating the number of species to attain sufficient representation in a random sample

Chao Deng, Timothy Daley, Peter Calabrese, Jie Ren, Andrew D. Smith

摘要:

使用初始样本来估计较大样本中的物种数量的统计问题在与生态学相距甚远的领域中找到了重要的应用。在这里,我们解决的一般问题,估计物种的数量,将代表在未来的样本中至少有一些r的意见。数字r表示具有足够观测值的物种,这通常用作任何稳健统计推断的必要条件。我们推导出一个程序来构造普遍适用于给定总体的相合估计量:一旦构造好,它们可以被评估为r的简单函数。我们的方法是基于代表至少r次的物种的数量和每单位时间发现的物种的预期数量的高阶导数之间的关系。结合这种关系与有理函数近似,我们提出了非参数估计,是准确的大值r和长程外推。我们进一步表明,我们的估计保留的渐近行为是必不可少的应用程序在大规模数据集。我们通过模拟和真实数据应用程序来评估这种方法的性能,以推断莎士比亚和狄更斯的词汇,Twitter社交网络的拓扑结构以及DNA测序数据中的分子多样性。

英文摘要:

The statistical problem of using an initial sample to estimate the number of species in a larger sample has found important applications in fields far removed from ecology. Here we address the general problem of estimating the number of species that will be represented by at least a number r of observations in a future sample. The number r indicates species with sufficient observations, which are commonly used as a necessary condition for any robust statistical inference. We derive a procedure to construct consistent estimators that apply universally for a given population: once constructed, they can be evaluated as a simple function of r. Our approach is based on a relation between the number of species represented at least r times and the higher derivatives of the expected number of species discovered per unit of time. Combining this relation with a rational function approximation, we propose nonparametric estimators that are accurate for both large values of r and long-range extrapolations. We further show that our estimators retain asymptotic behaviors that are essential for applications on large-scale datasets. We evaluate the performance of this approach by both simulation and real data applications for inferences of the vocabulary of Shakespeare and Dickens, the topology of a Twitter social network, and molecular diversity in DNA sequencing data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑