ToolGen: Unified Tool Retrieval and Calling via Generation
LibrAI;Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Microsoft(微软公司);University of California, Los Angeles(加州大学洛杉矶分校);The University of Melbourne(墨尔本大学)
Renxi Wang, Xudong Han, Lei Ji, Shu Wang, Timothy Baldwin, Haonan Li
As large language models (LLMs) advance, their inability to autonomously execute tasks by directly interacting with external tools remains a critical limitation. Traditional methods rely on inputting tool descriptions as context, which is constrained by context length and requires separate, often inefficient, retrieval mechanisms. We introduce ToolGen, a paradigm shift that integrates tool knowledge directly into the LLM's parameters by representing each tool as a unique token. This enables the LLM to generate tool calls and arguments as part of its next token prediction capabilities, seamlessly blending tool invocation with language generation. Our framework allows the LLM to access and utilize a vast amount of tools with no additional retrieval step, significantly enhancing both performance and scalability. Experimental results with over 47,000 tools show that ToolGen not only achieves superior results in both tool retrieval and autonomous task completion but also sets the stage for a new era of AI agents that can adapt to tools across diverse domains. By fundamentally transforming tool retrieval into a generative process, ToolGen paves the way for more versatile, efficient, and autonomous AI systems. ToolGen enables end-to-end tool learning and opens opportunities for integration with other advanced techniques such as chain-of-thought and reinforcement learning, thereby expanding the practical capabilities of LLMs.
Tool Calling: Enhancing Medication Consultation via Retrieval-Augmented Large Language Models
Shanghai Jiao Tong University(上海交通大学);Shanghai AI Laboratory(上海人工智能实验室);East China University of Science and Technology(华东理工大学);SenseTime Research(商汤科技研究院)
Self-Guided Function Calling in Large Language Models via Stepwise Experience Recall
The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences(认知与决策智能复杂系统重点实验室,自动化研究所,中国科学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学);Nanjing University of Information Science & Technology(南京信息工程大学);Institute of Computing Technology, Chinese Academy of Sciences(计算技术研究所,中国科学院)
OpenThaiGPT 1.5: A Thai-Centric Open Source Large Language Model
Mahidol University(玛希隆大学);iApp Technology Co., Ltd.(iApp科技有限公司);Artificial Intelligence Entrepreneur Association of Thailand (AIEAT)(泰国人工智能企业家协会);Big Data Institute (Public Organization)(大数据研究所(公立机构));Kasetsart University(农业大学)
TRACER: Verifiable Generative Provenance for Multimodal Tool-Using Agents
Shenyang Institute of Computing Technology, Chinese Academy of Sciences(中国科学院沈阳计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所MAIS);Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center (National Supercomputer Center in Jinan), Qilu University of Technology (Shandong Academy of Sciences)(教育部计算电力网络与信息安全重点实验室,山东计算机科学中心(济南国家超算中心),齐鲁工业大学(山东省科学院))