arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.13939cs.CL
收藏

基于Transformer的多语言文本分类评估

Evaluating Transformer-Based Multilingual Text Classification

University of California, Santa Barbara(加州大学圣巴巴拉分校)

Sophie Groenwold, Samhita Honnavalli, Lily Ou, Aesha Parekh, Sharon Levy, Diba Mirza, William Yang Wang

摘要:

随着NLP工具在当今的技术领域变得无处不在,它们越来越多地应用于具有各种类型结构的语言。然而,NLP研究并不主要集中在其分析最先进的语言模型的类型学差异。因此,NLP工具在具有不同句法和形态结构的语言中表现不平等。通过对词序类型学、形态类型学和比较语言学的详细讨论,我们确定了哪些变量最影响语言建模效果;此外,我们计算了词序和形态相似性指数,以帮助我们的实证研究。然后,我们使用这个背景来支持我们的分析,我们进行的实验,使用多类文本分类的八种语言和八个模型。

英文摘要:

As NLP tools become ubiquitous in today's technological landscape, they are increasingly applied to languages with a variety of typological structures. However, NLP research does not focus primarily on typological differences in its analysis of state-of-the-art language models. As a result, NLP tools perform unequally across languages with different syntactic and morphological structures. Through a detailed discussion of word order typology, morphological typology, and comparative linguistics, we identify which variables most affect language modeling efficacy; in addition, we calculate word order and morphological similarity indices to aid our empirical study. We then use this background to support our analysis of an experiment we conduct using multi-class text classification on eight languages and eight models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑