Large language models (LLMs) have revolutionized natural language processing (NLP) by excelling at understanding and generating human-like text. However, their widespread deployment can be prohibitively expensive. SortedNet is a recent training technique for enabling dynamic inference by leveraging the modularity in networks and sorting sub-models based on computation/accuracy in a nested manner. We extend SortedNet to generative NLP tasks, making large language models dynamic without any Pre-Training and by only replacing Standard Fine-Tuning (SFT) with Sorted Fine-Tuning (SoFT). Our approach boosts model efficiency, eliminating the need for multiple models for various scenarios during inference. We show that this approach can unlock the power of intermediate layers of transformers in generating the target output. Our sub-models remain integral components of the original model, minimizing storage requirements and transition costs between different computational/latency budgets. The efficacy of our proposed method was demonstrated by applying it to tune LLaMA 2 13B on the Stanford Alpaca dataset for instruction following and TriviaQA for closed-book question answering. Our results show the superior performance of sub-models in comparison to Standard Fine-Tuning and SFT+ICT (Early-Exit), all achieved with efficient tuning and without additional memory usage during inference.
Unlocking the Potential of ChatGPT: A Comprehensive Exploration of its Applications, Advantages, Limitations, and Future Directions in Natural Language Processing
Unlocking Recursive Thinking of LLMs: Alignment via Refinement
Soochow University(苏州大学);Zhipu AI(智谱AI);Tsinghua University(清华大学);Key Laboratory of Data Intelligence and Advanced Computing, Soochow University(苏州大学数据智能与先进计算重点实验室)
RomanSetu: Efficiently unlocking multilingual capabilities of Large Language Models via Romanization
Nilekani Centre at AI4Bharat(AI4Bharat的尼莱卡尼中心);National Institute of Information and Communications Technology(国家信息通信技术研究所);Indian Institute of Technology Madras(印度马德拉斯理工学院);Flipkart;Microsoft(微软);IIIT D&M Kancheepuram;Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Institute for Infocomm Research (IR), A * STAR, Singapore(新加坡资讯通信研究院(A*STAR));Indian Institute of Technology Bombay(印度孟买理工学院)
INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Beijing Academy of Artificial Intelligence(北京人工智能研究院);School of Computer Science, Beijing University of Posts and Telecommunications(北京邮电大学计算机学院);School of Artificial Intelligence, Nankai University(南开大学人工智能学院)
Instruction-Tuning Large Language Models with Medical Classification Data Improves ICD Coding of German Tumor Diagnoses
University Medical Center of the Johannes Gutenberg University Mainz(美因茨约翰内斯·古腾堡大学医学中心);University Cancer Center of the Johannes Gutenberg University Mainz(美因茨约翰内斯·古腾堡大学癌症中心)
Unlocking Continual Learning Abilities in Language Models
School of Computing and Data Science, The University of Hong Kong(香港大学计算与数据科学学院);CUHK-SZ(香港中文大学(深圳));Tsinghua University(清华大学);University of Edinburgh(爱丁堡大学);NVIDIA(英伟达公司);HKUST(香港科技大学);ICT, Chinese Academy of Sciences(中国科学院信息技术研究所)
Unlocking the Potential of Model Merging for Low-Resource Languages
Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);State Key Laboratory of General Artificial Intelligence, Peking University(北京大学通用人工智能国家重点实验室);Center for Data Science, Peking University(北京大学数据科学中心);College of Engineering, Peking University(北京大学工学院)