arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.07666cs.LGcs.AIcs.CLcs.CV
收藏

在大语言模型、多模态大语言模型及更广泛的领域中进行模型融合:方法、理论、应用与机遇

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities

Shenzhen Campus of Sun Yat-sen University, China(中山大学深圳校区);Northeastern University China(东北大学);Shenzhen Campus of Sun Yat-sen University China(中山大学深圳校区);Nanyang Technological University Singapore(南洋理工大学);Northeastern University(东北大学);Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);Nanyang Technological University(南洋理工大学);Institute for Clarity in Documentation Dublin Ohio USA(文档清晰研究所);Inria Paris-Rocquencourt Rocquencourt France(巴黎-罗quentourt研究所);Rajiv Gandhi University Doimukh Arunachal Pradesh India(拉贾·甘地大学);Tsinghua University Haidian Qu Beijing Shi China(清华大学);Palmer Research Laboratories San Antonio Texas USA(帕勒研究中心);Institute for Clarity in Documentation(文档清晰研究所);Inria Paris-Rocquencourt(巴黎-罗quentourt研究所);Rajiv Gandhi University(拉贾·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒研究中心)

Enneng Yang, Li Shen, Guibing Guo, Xingwei Wang, Xiaochun Cao, Jie Zhang, Dacheng Tao

AI总结:

本文综述了模型融合的方法、理论、应用及未来方向,提出新的分类方法并探讨其在多个机器学习领域的应用及挑战。

摘要:

模型融合是机器学习社区中一种高效的增强技术,不需要收集原始训练数据,也不需要昂贵的计算。随着模型融合在各个领域中的普及程度越来越高,全面理解现有的模型融合技术变得至关重要。然而,文献中在系统和深入地回顾这些技术方面存在显著的空白。本文调查提供了一种全面的模型融合方法和理论的概述,以及它们在各种领域和环境中的应用,以及未来的研究方向。具体而言,我们首先提出了一种新的分类方法,全面讨论现有的模型融合方法。其次,我们讨论了模型融合技术在大语言模型、多模态大语言模型以及超过十个机器学习子领域中的应用,包括持续学习、多任务学习、少样本学习等。最后,我们强调了模型融合的剩余挑战,并讨论了未来的研究方向。一份关于模型融合的全面论文列表可在https://github.com/EnnengYang/Awesome-Model-Merging-Methods-Theories-Applications上找到。

英文摘要:

Model merging is an efficient empowerment technique in the machine learning community that does not require the collection of raw training data and does not require expensive computation. As model merging becomes increasingly prevalent across various fields, it is crucial to understand the available model merging techniques comprehensively. However, there is a significant gap in the literature regarding a systematic and thorough review of these techniques. This survey provides a comprehensive overview of model merging methods and theories, their applications in various domains and settings, and future research directions. Specifically, we first propose a new taxonomic approach that exhaustively discusses existing model merging methods. Secondly, we discuss the application of model merging techniques in large language models, multimodal large language models, and more than ten machine learning subfields, including continual learning, multi-task learning, few-shot learning, etc. Finally, we highlight the remaining challenges of model merging and discuss future research directions. A comprehensive list of papers about model merging is available at https://github.com/EnnengYang/Awesome-Model-Merging-Methods-Theories-Applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑