Open-source pre-trained Large Language Models (LLMs) exhibit strong language understanding and generation capabilities, making them highly successful in a variety of tasks. However, when used as agents for dealing with complex problems in the real world, their performance is far inferior to large commercial models such as ChatGPT and GPT-4. As intelligent agents, LLMs need to have the capabilities of task planning, long-term memory, and the ability to leverage external tools to achieve satisfactory performance. Various methods have been proposed to enhance the agent capabilities of LLMs. On the one hand, methods involve constructing agent-specific data and fine-tuning the models. On the other hand, some methods focus on designing prompts that effectively activate the reasoning abilities of the LLMs. We explore both strategies on the 7B and 13B models. We propose a comprehensive method for constructing agent-specific data using GPT-4. Through supervised fine-tuning with constructed data, we find that for these models with a relatively small number of parameters, supervised fine-tuning can significantly reduce hallucination outputs and formatting errors in agent tasks. Furthermore, techniques such as multi-path reasoning and task decomposition can effectively decrease problem complexity and enhance the performance of LLMs as agents. We evaluate our method on five agent tasks of AgentBench and achieve satisfactory results.
Enhancing Multimodal Continual Instruction Tuning with BranchLoRA
Mohamed bin Zayed University of Artificial Intelligence(Mohamed bin Zayed大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Kyoto University(京都大学);Tencent AI Lab(腾讯AI实验室);Tomorrow Advancing Life(明天生命科技)
EstLLM: Enhancing Estonian Capabilities in Multilingual LLMs via Continued Pretraining and Post-Training
Institute of Computer Science, University of Tartu(塔尔图大学计算机科学研究院);Department of Software Science, Tallinn University of Technology(塔林技术大学软件科学系);Institute of the Estonian Language, Tallinn, Estonia(爱沙尼亚语言研究院);School of Humanities, Tallinn University(塔林大学人文学院)
Context-Alignment: Activating and Enhancing LLM Capabilities in Time Series
The Hong Kong Polytechnic University(香港理工大学);Ningbo Institute of Digital Twin(宁波数字孪生研究所);Eastern Institute of Technology(东部技术研究所);Shanghai Jiao Tong University(上海交通大学)
Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages
Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR))
Enhancing the Traditional Chinese Medicine Capabilities of Large Language Model through Reinforcement Learning from AI Feedback
School of Computer and Information Science, Southwest University(西南大学计算机与信息科学学院);School of Computing Technologies, RMIT University(RMIT大学计算技术学院);Yongdingmenwai Community Health Service Center(永定门外社区卫生服务中心)
Enhancing LLMs' Clinical Reasoning with Real-World Data from a Nationwide Sepsis Registry
Korea Advanced Institute of Science and Technology(韩国科学技术院);Microsoft(微软);Asan Medical Center, University of Ulsan College of Medicine(釜山大学医学院阿桑医疗中心);Samsung Medical Center, Sungkyunkwan University School of Medicine(成均馆大学医学院三星医疗中心);Seoul National University Bundang Hospital, Seoul National University College of Medicine(首尔国立大学医学院首尔国立大学医院)
Enhancing Text-to-SQL Capabilities of Large Language Models via Domain Database Knowledge Injection
School of Cyber Science Engineering, Huazhong University of Science and Technology(华中科技大学网络空间科学与工程学院);Wuhan AI Research Foundation Model Research Center(武汉人工智能研究基金会大模型研究中心);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Peng Cheng Laboratory(鹏城实验室)
CoT-Driven Framework for Short Text Classification: Enhancing and Transferring Capabilities from Large to Smaller Model
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);University of Chinese Academy of Sciences(中国科学院大学);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院)
BloomWise: Enhancing Problem-Solving capabilities of Large Language Models using Bloom's-Taxonomy-Inspired Prompts
Speech and Language Processing Group, National Technical University of Athens(国家技术大学雅典语音与语言处理组);Institute for Language and Speech Processing, Athena Research Center(雅典研究中心语言与语音处理研究所);National Technical University of Athens(国家技术大学雅典)
Enhancing Agentic Autonomous Scientific Discovery with Vision-Language Model Capabilities
Department of Physics, University of Cambridge, Cambridge, United Kingdom(剑桥大学物理系);Kavli Institute for Cosmology, University of Cambridge, Cambridge, United Kingdom(剑桥大学卡弗利天文研究所);Department of Physics and Astronomy, Haverford College, 370 Lancaster Avenue, Haverford, PA 19041, USA(哈弗福德学院物理与天文学系);Division of Physics, Mathematics and Astronomy, California Institute of Technology, Pasadena, CA 91125, USA(加州理工学院物理、数学与天文学系);Institute of Astronomy, University of Cambridge, Cambridge, United Kingdom(剑桥大学天文研究所)
A Structured Framework for Evaluating and Enhancing Interpretive Capabilities of Multimodal LLMs in Culturally Situated Tasks
DJCAD, University of Dundee, United Kingdom(邓迪大学DJCAD部门);ARG-tech, SSEN, University of Dundee, United Kingdom(邓迪大学);School of Computer Science, University of Birmingham, United Kingdom(伯明翰大学计算机科学学院)
ShifCon: Enhancing Non-Dominant Language Capabilities with a Shift-based Multilingual Contrastive Framework
Tsinghua University(清华大学);Microsoft(微软);University of Southern California(南加州大学);University of California, San Diego(加州大学圣地亚哥分校);University of California, Los Angeles(加州大学洛杉矶分校)
Instruct-of-Reflection: Enhancing Large Language Models Iterative Reflection Capabilities via Dynamic-Meta Instruction
Beijing University of Posts and Telecommunications(北京邮电大学);AI Lab of Lenovo Research(联想研究院AI实验室);Tianjin University(天津大学);The Hong Kong University of Science and Technology(香港科技大学)
Enhancing Perception Capabilities of Multimodal LLMs with Training-Free Fusion
ZIP Lab, Zhejiang University(浙江大学 ZIP 实验室);South China University of Technology(华南理工大学);Pazhou Lab(琶洲实验室);Key Laboratory of Big Data and Intelligent Robot, Ministry of Education(大数据与智能机器人教育部重点实验室)
Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilities
Rutgers University(罗格斯大学);Shanghai Jiaotong University(上海交通大学);University of Liverpool(利物浦大学);New Jersey Institute of Technology(新泽西理工学院);Xi’an Jiaotong-Liverpool University(西交利物浦大学)