arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.04790cs.CLcs.AI
收藏

大语言模型的在线训练:边聊天边学习

Online Training of Large Language Models: Learn while chatting

The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shenzhen Research Institute of Big Data(深圳大数据研究院)

Juhao Liang, Ziwei Wang, Zhuoheng Ma, Jianquan Li, Zhiyi Zhang, Xiangbo Wu, Benyou Wang

AI总结:

针对大语言模型现有交互范式灵活性不足、定制化难、缺乏持续学习的问题,本文提出“基于外部交互的在线训练”新范式,融合实时持续更新与个性化定制优势。

摘要:

大语言模型(LLMs)已极大地革新了自然语言处理(NLP)领域,其卓越的能力已得到广泛应用。然而,现有LLM与用户的交互范式受限于灵活性不足、定制化受限或缺乏持续学习能力。这种不灵活性尤为明显:用户,尤其是无编程技能的用户,提升或个性化定制模型的途径十分有限。现有框架还因计算效率低下、缺乏用户友好界面,让模型训练与部署流程更为复杂。为应对这些挑战,本文提出一种新型交互范式——“基于外部交互的在线训练”,该范式融合了模型持续实时更新的优势,以及通过AI智能体、在线/离线知识库等外部交互实现个性化定制的灵活性。

英文摘要:

Large Language Models(LLMs) have dramatically revolutionized the field of Natural Language Processing(NLP), offering remarkable capabilities that have garnered widespread usage. However, existing interaction paradigms between LLMs and users are constrained by either inflexibility, limitations in customization, or a lack of persistent learning. This inflexibility is particularly evident as users, especially those without programming skills, have restricted avenues to enhance or personalize the model. Existing frameworks further complicate the model training and deployment process due to their computational inefficiencies and lack of user-friendly interfaces. To overcome these challenges, this paper introduces a novel interaction paradigm-'Online Training using External Interactions'-that merges the benefits of persistent, real-time model updates with the flexibility for individual customization through external interactions such as AI agents or online/offline knowledge bases.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑