arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1708.07903cs.SIcs.CL
收藏

基于姓名嵌入的国籍分类

Nationality Classification Using Name Embeddings

Stony Brook University(石溪大学);Yahoo! Research(雅虎研究院);Amazon AI(亚马逊人工智能);NEC Labs America(NEC美国实验室)

Junting Ye, Shuchu Han, Yifan Hu, Baris Coskun, Meizhu Liu, Hong Qin, Steven Skiena

摘要:

国籍识别可以提供重要的人口统计信息,在生物医学和社会学研究中有许多应用。现有的基于姓名的国籍分类器使用姓名子串作为特征,并在通常从维基百科提取的小的、不具代表性的标记姓名集合上进行训练。因此,这些方法实现有限的性能,不能支持细粒度的分类。我们利用通信模式中的同质性现象来学习名称嵌入,这是一种编码性别,种族和国籍的新表示,可以很容易地应用于构建分类器和其他系统。通过对一家大型互联网公司的5700万联系人列表的分析,我们能够设计出一个细粒度的国籍分类器,覆盖了39个群体,占世界人口的90%以上。在对其他已发布的13个常见类别的系统进行评估时,我们的F1评分(0.795)明显优于我们最接近的竞争对手Ethnea(0.580)。据我们所知,这是最准确的,细粒度的国籍分类器。作为一个社交媒体应用程序,我们将分类器应用于六个不同领域的主要Twitter名人的追随者。我们展示了特朗普和奥巴马追随者的种族差异,以及不同群体所青睐的体育和娱乐活动。最后,我们确定了一个反常的政治人物,他的追随者似乎很大程度上无法阅读他发布的语言。

英文摘要:

Nationality identification unlocks important demographic information, with many applications in biomedical and sociological research. Existing name-based nationality classifiers use name substrings as features and are trained on small, unrepresentative sets of labeled names, typically extracted from Wikipedia. As a result, these methods achieve limited performance and cannot support fine-grained classification. We exploit the phenomena of homophily in communication patterns to learn name embeddings, a new representation that encodes gender, ethnicity, and nationality which is readily applicable to building classifiers and other systems. Through our analysis of 57M contact lists from a major Internet company, we are able to design a fine-grained nationality classifier covering 39 groups representing over 90% of the world population. In an evaluation against other published systems over 13 common classes, our F1 score (0.795) is substantial better than our closest competitor Ethnea (0.580). To the best of our knowledge, this is the most accurate, fine-grained nationality classifier available. As a social media application, we apply our classifiers to the followers of major Twitter celebrities over six different domains. We demonstrate stark differences in the ethnicities of the followers of Trump and Obama, and in the sports and entertainments favored by different groups. Finally, we identify an anomalous political figure whose presumably inflated following appears largely incapable of reading the language he posts in.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑