This work introduces EE-Tuning, a lightweight and economical solution to training/tuning early-exit large language models (LLMs). In contrast to the common approach of full-parameter pre-training, EE-Tuning augments any pre-trained (and possibly fine-tuned) standard LLM with additional early-exit layers that are tuned in a parameter-efficient manner, which requires significantly less computational resources and training data. Our implementation of EE-Tuning achieves outstanding training efficiency via extensive performance optimizations, as well as scalability due to its full compatibility with 3D parallelism. Results of systematic experiments validate the efficacy of EE-Tuning, confirming that effective early-exit LLM inference can be achieved with a limited training budget. In hope of making early-exit LLMs accessible to the community, we release the source code of our implementation of EE-Tuning at https://github.com/pan-x-c/EE-LLM.
Early Exit and Multi Stage Knowledge Distillation in VLMs for Video Summarization
Department of Computer Science and Engineering, IIT Bombay(印度理工学院班加罗尔计算机科学与工程系);Center of Machine Intelligence and Data Science (C-MInDS), IIT Bombay(印度理工学院班加罗尔人工智能与数据科学中心)
DnA-Eval: Enhancing Large Language Model Evaluation through Decomposition and Aggregation
National University of Singapore(新加坡国立大学);Salesforce Research(Salesforce研究院);Nanyang Technological University(南洋理工大学);Institute for Infocomm Research (IR)(信息通信研究院);A*STAR(新加坡科技研究局)
Controlling Performance and Budget of a Centralized Multi-agent LLM System with Reinforcement Learning
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Apple(苹果公司);University of California, Berkeley(加州大学伯克利分校);Northwestern University(西北大学);Harvard University(哈佛大学);Virginia Tech(弗吉尼亚理工大学)
Efficient and Scalable Granular-ball Graph Coarsening Method for Large-scale Graph Node Classification
School of Computer Science and Technology, Chongqing Key Laboratory of Computational Intelligence, Key Laboratory of Cyberspace Big Data Intelligent Security, Ministry of Education, Sichuan-Chongqing Co-construction Key Laboratory of Digital Economy Intelligence and Key Laboratory of Big Data Intelligent Computing(计算机科学与技术学院,重庆 computational intelligence 重点实验室,网络安全大数据智能安全重点实验室,教育部,四川-重庆共建数字经济智能重点实验室和大数据智能计算重点实验室);School of Computer Science and Technology, School of Cyber Security and Information Law, Chongqing University of Posts and Telecommunications(计算机科学与技术学院,网络安全与信息法学院,重庆邮电大学);Chongqing Key Laboratory of Brain-Inspired Cognitive Computing and Educational Rehabilitation for Children with Special Needs, Chongqing Normal University(脑启发认知计算与特殊儿童教育康复重庆重点实验室,重庆师范大学)