arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.10936cs.CLcs.AI
收藏

多语言大型语言模型综述:最新进展与新前沿

A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontiers

Beijing Jiaotong University(北京交通大学);University of Montreal(蒙特利尔大学);University of Waterloo(滑铁卢大学);Tsinghua University(清华大学)

Kaiyu Huang, Fengran Mo, Xinyu Zhang, Hongliang Li, You Li, Yuanchi Zhang, Weijian Yi, Yulong Mao, Jinchen Liu, Yuzhuang Xu, Jinan Xu, Jian-Yun Nie, Yang Liu

AI总结:

本文综述多语言 LLMs 的研究转变、训练推理、检索、安全、文化领域与数据集等问题,总结挑战、解决方案和未来方向。

摘要:

大型语言模型(LLMs)的快速发展在自然语言处理中展现出显著的多语言能力,吸引了学术界和工业界的全球关注。为减少潜在歧视并提升不同语言用户群体的整体可用性与可及性,发展语言公平技术十分重要。尽管 LLMs 已取得突破,但针对多语言场景的研究仍然不足,因此需要一项全面综述来总结近期方法、进展、局限和潜在解决方案。为此,我们从多个视角对 LLMs 在多语言场景中的使用进行综述。我们首先重新思考以往与当前预训练语言模型研究之间的转变。随后,介绍关于 LLMs 多语言性的若干视角,包括训练与推理方法、信息检索、模型安全、结合语言文化的多领域问题以及数据集使用。我们还讨论这些方面出现的主要挑战及可能的解决方案。此外,我们强调旨在进一步增强 LLMs 多语言能力的未来研究方向。本综述旨在帮助研究共同体解决多语言问题,并全面理解基于 LLMs 的多语言自然语言处理中的核心概念、关键技术和最新发展。

英文摘要:

The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and enhance the overall usability and accessibility for diverse language user groups, it is important for the development of language-fair technology. Despite the breakthroughs of LLMs, the investigation into the multilingual scenario remains insufficient, where a comprehensive survey to summarize recent approaches, developments, limitations, and potential solutions is desirable. To this end, we provide a survey with multiple perspectives on the utilization of LLMs in the multilingual scenario. We first rethink the transitions between previous and current research on pre-trained language models. Then we introduce several perspectives on the multilingualism of LLMs, including training and inference methods, information retrieval, model security, multi-domain with language culture, and usage of datasets. We also discuss the major challenges that arise in these aspects, along with possible solutions. Besides, we highlight future research directions that aim at further enhancing LLMs with multilingualism. The survey aims to help the research community address multilingual problems and provide a comprehensive understanding of the core concepts, key techniques, and latest developments in multilingual natural language processing based on LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑