Flexora: Flexible Low Rank Adaptation for Large Language Models
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东人工智能与数字经济实验室);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));School of Information Technology, Carleton University(卡尔顿大学信息科技学院)
Chenxing Wei, Yao Shu, Ying Tiffany He, Fei Richard Yu
Large Language Models (LLMs) are driving advancements in artificial intelligence by increasing the scale of model parameters, which has significantly enhanced generalization ability and unlocked new capabilities in practice. However, their performance in specific downstream tasks is usually hindered by their knowledge boundaries on these tasks. Thus, fine-tuning techniques, especially the widely used Low-Rank Adaptation (LoRA) method, have been introduced to expand the boundaries on these tasks, whereas LoRA would underperform on certain tasks owing to its potential overfitting on these tasks. To overcome this overfitting and improve the performance of LoRA, we propose the flexible low rank adaptation (Flexora) method to automatically and flexibly select the most important layers needing to be fine-tuned to achieve the best performance on different downstream tasks. Specifically, Flexora firstly frames this layer selection problem as a well-defined hyperparameter optimization (HPO) problem, then addresses it using the unrolled differentiation (UD) method, and finally selects the most useful layers based on the optimized hyperparameters. Our extensive experiments on many pretrained models and natural language tasks show that Flexora is able to consistently improve over the existing baselines, indicating the effectiveness of our Flexora in practice. We additionally provide insightful theoretical results and many ablation studies to deliver a comprehensive understanding of our Flexora.
Structured, flexible, and robust: benchmarking and improving large language models towards more human-like behavior in out-of-distribution reasoning tasks
MOMO: A framework for seamless physical, verbal, and graphical robot skill learning and adaptation
German Aerospace Center (DLR), Institute of Robotics and Mechatronics (RMC)(德国航空航天中心(DLR)机器人与机电研究所);School of Computation, Information and Technology (CIT), Technical University of Munich (TUM)(计算、信息与技术学院(CIT),慕尼黑技术大学)
Perceiver-Prompt: Flexible Speaker Adaptation in Whisper for Chinese Disordered Speech Recognition
Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);The Chinese University of Hong Kong(香港中文大学);Shenzhen Institute of Advanced Technology, CAS(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学)
Flexible Multitask Learning with Factorized Diffusion Policy
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Harvard University(哈佛大学);Norwegian University of Science and Technology(挪威科学与技术大学);Columbia University(哥伦比亚大学)
TacticCraft: Natural Language-Driven Tactical Adaptation for StarCraft II
Institute of Automation, Chinese Academy of Sciences, China(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences, China(中国科学院大学人工智能学院);Tencent AI Lab, Shenzhen, China(腾讯AI实验室);Nanjing Artificial Intelligence Research of IA, China(南京人工智能研究院)