To address intricate real-world tasks, there has been a rising interest in tool utilization in applications of large language models (LLMs). To develop LLM-based agents, it usually requires LLMs to understand many tool functions from different tool documentation. But these documentations could be diverse, redundant or incomplete, which immensely affects the capability of LLMs in using tools. To solve this, we introduce EASYTOOL, a framework transforming diverse and lengthy tool documentation into a unified and concise tool instruction for easier tool usage. EasyTool purifies essential information from extensive tool documentation of different sources, and elaborates a unified interface (i.e., tool instruction) to offer standardized tool descriptions and functionalities for LLM-based agents. Extensive experiments on multiple different tasks demonstrate that EasyTool can significantly reduce token consumption and improve the performance of tool utilization in real-world scenarios. Our code will be available at \url{https://github.com/microsoft/JARVIS/} in the future.
University of Southern California(南加州大学);University of Chicago(芝加哥大学);Temple University(天普大学);University of Birmingham(伯明翰大学);Toyota Technological Institute at Chicago(芝加哥丰田技术研究院);Penn State University(宾夕法尼亚州立大学)
CML-Bench: A Framework for Evaluating and Enhancing LLM-Powered Movie Scripts Generation
The Hong Kong University of Science and Technology(香港科学与技术大学);Lehigh University(莱斯大学);Fudan University(复旦大学);Emory University(埃默里大学);University of Central Florida(中央佛罗里达大学)
Few-shot Language Coordination by Modeling Theory of Mind
Carnegie Mellon University(卡内基梅隆大学)
$\textit{No man is an island.}$人类通过在简短的对话中与不同的对话者进行协调来与大型社区进行交流。这种能力已经被构建神经通信代理的研究所忽视。我们研究了Few-Shot $\textit{language coordination}$的任务:智能体快速适应他们的会话伙伴的语言能力。与目前的自我游戏训练的沟通代理不同,我们需要领导代理与具有不同语言能力的代理$\textit{population}$协调,快速适应与人口中看不见的代理进行沟通。这就需要有能力模仿伴侣的信念,这是人类沟通的重要组成部分。从心理理论(ToM; Premack& Woodruff(1978))中获得灵感,我们研究了说话者明确地模拟听者的心理状态的效果。正如我们的实验所示,说话者获得了预测其伙伴反应的能力,这有助于它生成简明表达其交际目标的指令。我们研究了我们的假设,即与心理理论建模生成的指令产生更好的通信性能在参考游戏和语言导航任务。从我们的实验中的积极结果暗示的重要性,明确建模通信作为一个社会语用的进步。