提升人类活动数据:生态视角
Upscaling human activity data: an ecological perspective
摘要:
近年来,我们目睹了从电子邮件通信到社交网络活动等不同人类动态收集的数据爆炸式增长。从这些庞大的数据集中提取有用的信息是一项重大挑战。在过去的几十年里,统计的不确定性在人类活动中被广泛观察到,并提出了各种模型。在这里,我们从建模到推理,并提出了一个统计框架,能够预测全球功能的人类活动从当地的知识。我们考虑四个人类活动的数据集:电子邮件通信,Twitter帖子,维基百科文章和古腾堡书籍。从本地活动的统计数据中,例如在所考虑的数据集的小样本中收集的每个用户发送的电子邮件,每个主题标签的帖子和单词的出现,我们推断出全局特征,即在全球范围内的用户,主题标签和单词的数量。我们的估计是稳健和准确的,具有很小的相对误差。此外,我们预测一个标签或一个词的丰度可能会通过尺度发生变化。因此,通过观察一小部分推文和其中给定标签的受欢迎程度,我们可以估计它是否会在网络的不可见部分保持受欢迎。我们的方法是基于统计生态学,因为我们发现看不见的人类活动特征的推断可以映射到生物多样性中看不见的物种问题。我们的研究结果可以应用于不同的领域,从电子邮件中的资源管理到Twitter中的集体注意力监测,以及Word数据库中的语言学习过程。
英文摘要:
In recent years we have witnessed an explosion of data collected for different human dynamics, from email communication to social networks activities. Extract useful information from these huge data sets represents a major challenge. In the last decades, statistical regularities has been widely observed in human activities and various models have been proposed. Here we move from modeling to inference and propose a statistical framework capable to predict global features of human activities from local knowledge. We consider four data sets of human activities: email communication, Twitter posts, Wikipedia articles and Gutenberg books. From the statistics of local activities, such as sent emails per senders, post per hashtags and word occurrences collected in a small sample of the considered dataset, we infer global features, as the number of senders, hashtags and words at the global scale. Our estimates are robust and accurate with a small relative error. Moreover, we predict how abundance of a hashtag or of a word may change through scales. Thus, observing a small portion of tweets and the popularity of a given hashtag among them, we can estimate whether it will remain popular or not in the unseen part of the network. Our approach is grounded on statistical ecology as we discover inference of unseen human activity hallmarks can be mapped into the unseen species problem in biodiversity. Our findings may have applications to different areas, from resource management in emails to collective attention monitoring in Twitter and to language learning process in word databases.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。