arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.03220cs.LG
收藏

不同大型语言模型架构综述:趋势、基准与挑战

Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challenges

New York University(纽约大学);New York University Abu Dhabi(纽约大学阿布扎比分校)

Minghao Shao, Abdul Basit, Ramesh Karri, Muhammad Shafique

AI总结:

本文综述 LLM 与 MLLM 的架构演进、技术特征、基准表现及挑战,比较最新多模态模型并展望未来方向。

摘要:

大型语言模型(LLMs)代表了一类擅长理解自然语言并针对各种提示或查询生成连贯回复的深度学习模型。这些模型的复杂度远超传统神经网络,通常包含数十个神经网络层,并拥有数十亿到数万亿个参数。它们通常在海量数据集上进行训练,采用基于 transformer 块的架构。当代 LLMs 是多功能的,能够执行从文本生成、语言翻译到问答,以及代码生成和分析等一系列任务。这些模型中的一个先进子集被称为多模态大型语言模型(MLLMs),它扩展了 LLM 的能力,以处理和解释包括图像、音频和视频在内的多种数据模态。这种增强赋予 MLLMs 视频编辑、图像理解以及视觉内容字幕生成等能力。本综述全面概述了 LLMs 的最新进展。我们首先追溯 LLMs 的演进,随后深入探讨 MLLMs 的出现及其细微特征。我们分析了新兴的最先进 MLLMs,探究其技术特征、优势和局限性。此外,我们对这些模型进行了比较分析,并讨论了它们面临的挑战、潜在局限性以及未来发展前景。

英文摘要:

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural networks, often encompassing dozens of neural network layers and containing billions to trillions of parameters. They are typically trained on vast datasets, utilizing architectures based on transformer blocks. Present-day LLMs are multi-functional, capable of performing a range of tasks from text generation and language translation to question answering, as well as code generation and analysis. An advanced subset of these models, known as Multimodal Large Language Models (MLLMs), extends LLM capabilities to process and interpret multiple data modalities, including images, audio, and video. This enhancement empowers MLLMs with capabilities like video editing, image comprehension, and captioning for visual content. This survey provides a comprehensive overview of the recent advancements in LLMs. We begin by tracing the evolution of LLMs and subsequently delve into the advent and nuances of MLLMs. We analyze emerging state-of-the-art MLLMs, exploring their technical features, strengths, and limitations. Additionally, we present a comparative analysis of these models and discuss their challenges, potential limitations, and prospects for future development.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑