连接“低资源”场景中的思想:面向国家语言变体、克里奥尔语及其他低资源场景的自然语言处理
Connecting Ideas in 'Lower-Resource' Scenarios: NLP for National Varieties, Creoles and Other Low-resource Scenarios
AI总结:
本教程旨在连接低资源场景(方言、克里奥尔语等)NLP研究的共同挑战与方法,促进跨场景合作,以应对数据匮乏问题。
摘要:
尽管大型语言模型在少数语言子集的基准测试上取得了优异结果,但在处理来自“低资源”场景的语言文本时仍存在困难,例如方言或社会方言(语言的国家或社会变体)、克里奥尔语(多种语言接触产生的语言)以及其他低资源语言。本入门教程将识别自然语言处理(NLP)研究中应对和克服数据匮乏环境固有障碍的共同挑战、方法和主题。通过将过去的思想与当前领域联系起来,本教程旨在激发在这些场景中工作的研究人员之间的合作与交叉融合。我们对“低资源”的概念广义上指模型训练所需数据的显著缺乏——并且可能适用于教程所涵盖的三种场景之外的其他场景。
英文摘要:
Despite excellent results on benchmarks over a small subset of languages, large language models struggle to process text from languages situated in `lower-resource' scenarios such as dialects/sociolects (national or social varieties of a language), Creoles (languages arising from linguistic contact between multiple languages) and other low-resource languages. This introductory tutorial will identify common challenges, approaches, and themes in natural language processing (NLP) research for confronting and overcoming the obstacles inherent to data-poor contexts. By connecting past ideas to the present field, this tutorial aims to ignite collaboration and cross-pollination between researchers working in these scenarios. Our notion of `lower-resource' broadly denotes the outstanding lack of data required for model training - and may be applied to scenarios apart from the three covered in the tutorial.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。