arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.18807cs.AI
收藏

带有工具的大语言模型:一项综述

LLM With Tools: A Survey

Tongji University(同济大学)

Zhuocheng Shen

AI总结:

本文综述了教授大语言模型使用外部工具的方法、挑战与发展,提出了标准化工具集成范式,探讨了微调与上下文学习技术,并展望了LLM自主创建工具的前景及Chameleon复现实验。

摘要:

工具的集成在增强大语言模型处理特定复杂任务的效率和准确性方面提供了一种新方法。本文深入探讨了教授LLM使用外部工具的方法、挑战和发展,从而将其能力边界推向既有知识库之外。我们引入了一种标准化的工具集成范式,该范式由一系列将用户指令映射为可执行计划及其执行的函数指导,强调了理解用户意图、工具选择和动态计划调整的重要性。我们的探索揭示了遇到的各种挑战,如工具调用时机、选择准确性以及对稳健推理过程的需求。在应对这些挑战时,我们在微调和上下文学习范式背景下研究了相关技术,强调了确保多样性、增强数据集和提升泛化能力的创新方法。此外,我们探讨了使LLM不仅能利用而且能自主创建工具的视角,这可能将其角色从单纯的工具使用者重新定义为工具创建者。最后,我们在ScienceQA上复现了Chameleon的结果并分析了代码结构。

英文摘要:

The integration of tools in augmenting large language models presents a novel approach toward enhancing the efficiency and accuracy of these models in handling specific, complex tasks. This paper delves into the methodology,challenges, and developments in the realm of teaching LLMs to use external tools, thereby pushing the boundaries of their capabilities beyond pre-existing knowledge bases. We introduce a standardized paradigm for tool integration guided by a series of functions that map user instructions to actionable plans and their execution, emphasizing the significance of understanding user intent, tool selection, and dynamic plan adjustment. Our exploration reveals the various challenges encountered, such as tool invocation timing, selection accuracy, and the need for robust reasoning processes. In addressing these challenges, we investigate techniques within the context of fine-tuning and incontext learning paradigms, highlighting innovative approaches to ensure diversity, augment datasets, and improve generalization.Furthermore, we investigate a perspective on enabling LLMs to not only utilize but also autonomously create tools, which may redefine their role from mere tool users to tool creators. Finally,we reproduced Chameleon's results on ScienceQA and analyzed the code structure.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑