arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.08326cs.CLcs.AI
收藏

RoTBench:评估大型语言模型在工具学习中鲁棒性的多级基准

RoTBench: A Multi-Level Benchmark for Evaluating the Robustness of Large Language Models in Tool Learning

School of Computer Science, Fudan University(复旦大学计算机科学学院);Institute of Modern Languages and Linguistics, Fudan University(复旦大学现代语言与语言学研究所);Shanghai Key Laboratory of Intelligent Information Processing, Fudan University(复旦大学上海智能信息处理重点实验室)

Junjie Ye, Yilong Wu, Songyang Gao, Caishuang Huang, Sixian Li, Guanyu Li, Xiaoran Fan, Qi Zhang, Tao Gui, Xuanjing Huang

AI总结:

本文提出多级基准RoTBench,通过构建五个噪声环境评估LLMs在工具选择、参数识别和内容填充阶段的鲁棒性,并发现GPT-4等模型在噪声下性能显著下降,进而提出RoTTuning策略以增强模型鲁棒性。

摘要:

工具学习作为大型语言模型(LLMs)与物理世界交互的重要手段,引起了广泛关注。当前研究主要强调LLMs在结构良好环境中使用工具的能力,却忽视了其在面对现实世界不可避免的噪声时的稳定性。为弥补这一空白,我们引入了RoTBench,一个用于评估LLMs在工具学习中鲁棒性的多级基准。具体而言,我们构建了五个外部环境,每个环境具有不同级别的噪声(即Clean、Slight、Medium、Heavy和Union),在三个关键阶段深入分析模型的韧性:工具选择、参数识别和内容填充。涉及六个广泛使用的模型的实验突显了增强LLMs在工具学习中鲁棒性的迫切需求。例如,当人工准确率没有实质性变化时,GPT-4的性能甚至从80.00显著下降到58.10。更令人惊讶的是,GPT家族固有的噪声纠正能力反而阻碍了其在面对轻微噪声时的适应性。基于这些发现,我们提出了RoTTuning,一种通过丰富训练环境多样性来增强LLMs在工具学习中鲁棒性的策略。代码和数据可在https://github.com/Junjie-Ye/RoTBench获取。

英文摘要:

Tool learning has generated widespread interest as a vital means of interaction between Large Language Models (LLMs) and the physical world. Current research predominantly emphasizes LLMs' capacity to utilize tools in well-structured environments while overlooking their stability when confronted with the inevitable noise of the real world. To bridge this gap, we introduce RoTBench, a multi-level benchmark for evaluating the robustness of LLMs in tool learning. Specifically, we establish five external environments, each featuring varying levels of noise (i.e., Clean, Slight, Medium, Heavy, and Union), providing an in-depth analysis of the model's resilience across three critical phases: tool selection, parameter identification, and content filling. Experiments involving six widely-used models underscore the urgent necessity for enhancing the robustness of LLMs in tool learning. For instance, the performance of GPT-4 even drops significantly from 80.00 to 58.10 when there is no substantial change in manual accuracy. More surprisingly, the noise correction capability inherent in the GPT family paradoxically impedes its adaptability in the face of mild noise. In light of these findings, we propose RoTTuning, a strategy that enriches the diversity of training environments to bolster the robustness of LLMs in tool learning. The code and data are available at https://github.com/Junjie-Ye/RoTBench.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑