Granite函数调用模型:通过细粒度任务的多任务学习引入函数调用能力
Granite-Function Calling Model: Introducing Function Calling Abilities via Multi-task Learning of Granular Tasks
AI总结:
本文提出GRANITE-20B-FUNCTIONCALLING模型,通过七项函数调用基础任务的多任务训练赋予LLM函数调用能力,在多个数据集上超越其他开放模型并具备更强泛化性。
摘要:
大型语言模型(LLMs)近期在作为智能体系统骨干方面展现出巨大潜力,其在SWE-Bench和Agent-Bench等多方面、具有挑战性的基准上的表现已证明了这一点。然而,要真正发挥LLMs作为自主智能体的潜力,它们必须学会识别、调用外部工具和应用程序接口(APIs)并与之交互,以完成复杂任务。这些任务统称为函数调用。赋予LLMs函数调用能力可带来诸多优势,例如能够访问数据库和知识源中的当前信息及特定领域信息,以及能够将可由工具可靠执行的任务外包出去,例如Python解释器或计算器。尽管LLMs在函数调用方面已取得显著进展,但能够与GPT、Claude和Gemini等专有LLMs相媲美的开放模型仍然匮乏。因此,在本工作中,我们以Apache 2.0许可证发布了GRANITE-20B-FUNCTIONCALLING模型。该模型采用多任务训练方法,针对函数调用所包含的七项基础任务进行训练,这些任务包括嵌套函数调用、函数链式调用、并行函数、函数名称检测、参数-值对检测、下一最佳函数以及响应生成。我们在多个分布外数据集上进行了全面评估,将GRANITE-20B-FUNCTIONCALLING与超过15个其他最佳的专有模型和开放模型进行了比较。GRANITE-20B-FUNCTIONCALLING在Berkeley Function Calling Leaderboard上的所有开放模型中取得了最佳性能,并在总体排名中位列第四。由于用于训练该模型的多样化任务和数据集,我们表明GRANITE-20B-FUNCTIONCALLING在七个不同评估数据集上的多项任务中具有更好的泛化能力。
英文摘要:
Large language models (LLMs) have recently shown tremendous promise in serving as the backbone to agentic systems, as demonstrated by their performance in multi-faceted, challenging benchmarks like SWE-Bench and Agent-Bench. However, to realize the true potential of LLMs as autonomous agents, they must learn to identify, call, and interact with external tools and application program interfaces (APIs) to complete complex tasks. These tasks together are termed function calling. Endowing LLMs with function calling abilities leads to a myriad of advantages, such as access to current and domain-specific information in databases and knowledge sources, and the ability to outsource tasks that can be reliably performed by tools, e.g., a Python interpreter or calculator. While there has been significant progress in function calling with LLMs, there is still a dearth of open models that perform on par with proprietary LLMs like GPT, Claude, and Gemini. Therefore, in this work, we introduce the GRANITE-20B-FUNCTIONCALLING model under an Apache 2.0 license. The model is trained using a multi-task training approach on seven fundamental tasks encompassed in function calling, those being Nested Function Calling, Function Chaining, Parallel Functions, Function Name Detection, Parameter-Value Pair Detection, Next-Best Function, and Response Generation. We present a comprehensive evaluation on multiple out-of-domain datasets comparing GRANITE-20B-FUNCTIONCALLING to more than 15 other best proprietary and open models. GRANITE-20B-FUNCTIONCALLING provides the best performance among all open models on the Berkeley Function Calling Leaderboard and fourth overall. As a result of the diverse tasks and datasets used for training our model, we show that GRANITE-20B-FUNCTIONCALLING has better generalizability on multiple tasks in seven different evaluation datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。