arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.01290cs.CL
收藏

在COVID-19期间测量语言多样性

Measuring Linguistic Diversity During COVID-19

University of Canterbury(坎特伯雷大学)

Jonathan Dunn, Tom Coupe, Benjamin Adams

摘要:

语言多样性的计算测量有助于我们使用数字语言数据来理解语言景观。本文的贡献是利用COVID-19疫情导致的国际旅行限制来校准语言多样性的衡量标准。以前的工作已经使用地理参考社交媒体和网络数据绘制了语言分布图。然而,我们的目标是描述这些语料库本身,而不是对潜在的人群做出推断。本文提出了一种基于Herfindahl-Hirschman指数的差异中的差异方法,该方法可以识别由非本地人群引入的数字语料库中的偏见。这些方法可以告诉我们哪些地方发生了重大变化,以及这是否会导致多样性增加或减少。这是将社交媒体等数字语料库与产生它们的现实世界人口相结合的重要一步。

英文摘要:

Computational measures of linguistic diversity help us understand the linguistic landscape using digital language data. The contribution of this paper is to calibrate measures of linguistic diversity using restrictions on international travel resulting from the COVID-19 pandemic. Previous work has mapped the distribution of languages using geo-referenced social media and web data. The goal, however, has been to describe these corpora themselves rather than to make inferences about underlying populations. This paper shows that a difference-in-differences method based on the Herfindahl-Hirschman Index can identify the bias in digital corpora that is introduced by non-local populations. These methods tell us where significant changes have taken place and whether this leads to increased or decreased diversity. This is an important step in aligning digital corpora like social media with the real-world populations that have produced them.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑