The integration of tools in augmenting large language models presents a novel approach toward enhancing the efficiency and accuracy of these models in handling specific, complex tasks. This paper delves into the methodology,challenges, and developments in the realm of teaching LLMs to use external tools, thereby pushing the boundaries of their capabilities beyond pre-existing knowledge bases. We introduce a standardized paradigm for tool integration guided by a series of functions that map user instructions to actionable plans and their execution, emphasizing the significance of understanding user intent, tool selection, and dynamic plan adjustment. Our exploration reveals the various challenges encountered, such as tool invocation timing, selection accuracy, and the need for robust reasoning processes. In addressing these challenges, we investigate techniques within the context of fine-tuning and incontext learning paradigms, highlighting innovative approaches to ensure diversity, augment datasets, and improve generalization.Furthermore, we investigate a perspective on enabling LLMs to not only utilize but also autonomously create tools, which may redefine their role from mere tool users to tool creators. Finally,we reproduced Chameleon's results on ScienceQA and analyzed the code structure.
Reasoning LLMs in the Medical Domain: A Literature Survey
Fraunhofer IAIS - Department of Media Engineering(弗劳恩霍夫研究所媒体工程部门);University of Bonn - Department of Computer Science(波恩大学计算机科学系);West-AI - Federal Ministry of Education and Research(西德人工智能 - 教育与研究部)
ToolTree: Efficient LLM Agent Tool Planning via Dual-Feedback Monte Carlo Tree Search and Bidirectional Pruning
School of Computing and Information Systems, The University of Melbourne(墨尔本大学计算与信息学院);School of Physics, Mathematics and Computing, The University of Western Australia(西澳大学物理、数学与计算学院)
AIn't Nothing But a Survey? Using Large Language Models for Coding German Open-Ended Survey Responses on Survey Motivation
Social Data Science & AI Lab, LMU Munich(社会科学与人工智能实验室,慕尼黑大学);Munich Center for Machine Learning(慕尼黑机器学习中心);University of Maryland, College Park(马里兰大学学院公园分校);GESIS – Leibniz Institute for the Social Sciences(莱比锡社会科学研究机构)
German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM Studies
University of Mannheim(曼海姆大学);GESIS -- Leibniz Institute for the Social Sciences(莱布尼茨社会科学研究所);RWTH Aachen University(亚琛工业大学);Complexity Science Hub(复杂性科学中心)
A Survey on Large Language Model Hallucination via a Creativity Perspective
Institute of Computing Technology, CAS(中国科学院计算技术研究所);University of Chinese Academy of Science(中国科学院大学);International Digital Economy Academy, IDEA Research(国际数字经济学院IDEA研究院)
Towards Scientific Intelligence: A Survey of LLM-based Scientific Agents
State Key Laboratory of Multimodal Artificial Intelligence Systems(多模态人工智能系统国家重点实验室);Foundation Model Research Center, Institute of Automation, CAS(自动化研究所基础模型研究中心);University of Chinese Academy of Science, Beijing, China(中国科学院大学,北京,中国);Wuhan AI Research, Wuhan, China(武汉人工智能研究)
LLM agents security duality: a comprehensive survey of self-security and empowered cybersecurity
School of Cyber Science and Engineering, Wuhan University(武汉大学计算机科学与工程学院);Department of Computer Science and Engineering, University at Buffalo(布法罗大学计算机科学与工程系)
LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarios
Beijing Jiaotong University(北京交通大学);Lancaster University(兰卡斯特大学);Max Planck Institute for Informatics, Saarland Informatics Campus(马克斯·普朗克研究所(信息学)萨尔兰州信息学校区);University of Electronic Science and Technology of China(电子科技大学)
From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future
School of Electrical and Computer Engineering, The University of Sydney(悉尼大学电气与计算机工程学院);University at Buffalo, SUNY(纽约州立大学布法罗分校);University of Chicago(芝加哥大学)
A Survey of LLM-based Agents in Medicine: How far are we from Baymax?
The Chinese University of Hong Kong(香港中文大学);Peking University(北京大学);City University of Hong Kong(香港城市大学);Massachusetts General Hospital and Harvard Medical School(麻省总医院和哈佛医学院)