将影响NLP任务的语言资源水平情境化
Contextualising Levels of Language Resourcedness that affect NLP tasks
AI总结：
本文提出通过上下文特征对语言资源进行分类，以更准确地评估影响NLP任务的语言资源水平。
摘要：
许多广泛使用的软件应用都涉及自然语言的某种形式处理，任务范围从数字化纸质材料和文本处理到语音生成。各种语言资源被用来开发软件系统以完成广泛的自然语言处理（NLP）任务，例如普遍存在的拼写检查器和聊天机器人。语言通常被分为低资源语言（LRL）或高资源语言（HRL），非洲语言被归类为资源稀缺语言，而英语则是最资源丰富的语言。但中间的情况又如何呢？我们主张对所有语言采用二元类型学（LRL和HRL）是存在问题的。通过清晰理解语言资源在社会中的情况，建立了一个矩阵，将语言分为非常LRL、LRL、RL、HRL和非常HRL。这种分类基于每个类别的上下文特征类型，而不是计数工具。每个特征和分类的动机都得到了提供。本文聚焦于非洲语言的资源情境化，并增强了对项目中使用的语言在该尺度上的位置的理解，可能有助于，例如，更好地规划研究和实施项目。因此，我们主张在给定的尺度内对项目中的语言资源进行分类是必不可少的，特别是对于处于该尺度下半部分的语言。
英文摘要：
Several widely used software applications involve some form of processing of natural language, with tasks ranging from digitising hardcopies and text processing to speech generation. Varied language resources are used to develop software systems to accomplish a wide range of natural language processing (NLP) tasks, such as the ubiquitous spellcheckers and chatbots. Languages are typically characterised as either low (LRL) or high resourced languages (HRL) with African languages having been characterised as resource-scarce languages and English by far the most well-resourced language. But what lies in-between? We argue that the dichotomous typology of LRL and HRL for all languages is problematic. Through a clear understanding of language resources situated in a society, a matrix is developed that characterises languages as Very LRL, LRL, RL, HRL and Very HRL. The characterisation is based on the typology of contextual features for each category, rather than counting tools. The motivation is provided for each feature and each characterisation. The contextualisation of resourcedness, with a focus on African languages in this paper, and an increased understanding of where on the scale the language used in a project is, may assist in, among others, better planning of research and implementation projects. We thus argue in this paper that the characterisation of language resources within a given scale in a project is an indispensable component, particularly for those in the lower half of the scale.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
