arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.04267cs.AIcs.CL
收藏

领域专用基础模型综述:关键技术、应用与挑战

An overview of domain-specific foundation model: key technologies, applications and challenges

Shenzhen Research Institute of Big Data(深圳大数据研究院);School of Science and Engineering(科学与工程学院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Department of Electronic Engineering and Information Science(电子工程与信息科学系);The Mobile Communications Innovation Center(移动通信创新中心);China Mobile Group Device Co., Ltd.(中国移动设备有限公司);School of Computer Science and Engineering(计算机科学与工程学院);National Mobile Communications Research Laboratory(国家移动通信研究中心);Purple Mountain Laboratories(紫金山实验室);School of Software Engineering(软件工程学院);School of Electrical and Electronic Engineering(电子与电气工程学院)

Haolong Chen, Hanzhi Chen, Zijian Zhao, Kaifeng Han, Guangxu Zhu, Yichen Zhao, Ying Du, Wei Xu, Qingjiang Shi

AI总结:

本文系统综述了领域专用基础模型的定制化方法,涵盖基本概念、通用架构、关键构建技术、应用领域及未来挑战,为各领域研究人员和从业者开发定制化基础模型提供指导。

摘要:

ChatGPT及其他基于基础模型的产品在人类语言理解方面表现卓越,这促使学术界和工业界探索如何针对特定行业和应用场景对这些模型进行定制。这一过程被称为领域专用基础模型(FMs)的定制化,旨在解决通用模型可能无法充分捕捉领域特定数据的独特模式与需求的局限性。尽管该方向十分重要,但目前明显缺乏关于构建领域专用基础模型的综合性综述论文,而针对通用模型的资源却十分丰富。为弥补这一空白,本文对定制领域专用基础模型的方法论进行了及时而全面的综述。文章介绍了基本概念,概述了通用架构,并梳理了构建领域专用模型的关键方法。此外,文章还讨论了可从这些专用模型中受益的多个领域,并指出了未来面临的挑战。通过本综述,我们旨在为来自不同领域的研究人员和从业者开发自己的定制化基础模型提供有价值的指导和参考。

英文摘要:

The impressive performance of ChatGPT and other foundation-model-based products in human language understanding has prompted both academia and industry to explore how these models can be tailored for specific industries and application scenarios. This process, known as the customization of domain-specific foundation models (FMs), addresses the limitations of general-purpose models, which may not fully capture the unique patterns and requirements of domain-specific data. Despite its importance, there is a notable lack of comprehensive overview papers on building domain-specific FMs, while numerous resources exist for general-purpose models. To bridge this gap, this article provides a timely and thorough overview of the methodology for customizing domain-specific FMs. It introduces basic concepts, outlines the general architecture, and surveys key methods for constructing domain-specific models. Furthermore, the article discusses various domains that can benefit from these specialized models and highlights the challenges ahead. Through this overview, we aim to offer valuable guidance and reference for researchers and practitioners from diverse fields to develop their own customized FMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑