arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.01502cs.LGcs.AI
收藏

真正重要的AI智能体

AI Agents That Matter

Princeton University(普林斯顿大学)

Sayash Kapoor, Benedikt Stroebl, Zachary S. Siegel, Nitya Nadgir, Arvind Narayanan

AI总结:

本文指出当前AI智能体基准测试过度关注准确率、忽视成本、混淆开发需求、缺乏留出集且评估不标准化,并提出联合优化准确率与成本及避免过拟合的框架,以推动开发真正实用的智能体。

摘要:

AI智能体是一个令人兴奋的新研究方向,智能体的开发由基准测试驱动。我们对当前智能体基准测试和评估实践的分析揭示了若干阻碍其在现实世界应用中发挥作用的缺陷。首先,当前仅狭隘地关注准确率,而忽视其他指标。因此,最先进的智能体不必要地复杂且成本高昂,社区对准确率提升来源得出了错误结论。我们在准确率之外同时关注成本,这促使我们提出联合优化这两个指标的新目标。我们设计并实现了一种此类优化方法,展示了其在保持准确率的同时大幅降低成本的潜力。其次,模型开发者和下游应用开发者的基准测试需求被混为一谈,使得难以确定哪个智能体最适合特定应用。第三,许多智能体基准测试的留出集不足,有时甚至完全没有。这导致智能体变得脆弱,因为它们走捷径并以各种方式过拟合基准测试。我们提出了一个避免过拟合的原则性框架。最后,评估实践缺乏标准化,导致普遍缺乏可复现性。我们希望我们为解决这些缺陷而提出的步骤将推动开发出在现实世界中有用的智能体,而不仅仅是在基准测试上准确。

英文摘要:

AI agents are an exciting new research direction, and agent development is driven by benchmarks. Our analysis of current agent benchmarks and evaluation practices reveals several shortcomings that hinder their usefulness in real-world applications. First, there is a narrow focus on accuracy without attention to other metrics. As a result, SOTA agents are needlessly complex and costly, and the community has reached mistaken conclusions about the sources of accuracy gains. Our focus on cost in addition to accuracy motivates the new goal of jointly optimizing the two metrics. We design and implement one such optimization, showing its potential to greatly reduce cost while maintaining accuracy. Second, the benchmarking needs of model and downstream developers have been conflated, making it hard to identify which agent would be best suited for a particular application. Third, many agent benchmarks have inadequate holdout sets, and sometimes none at all. This has led to agents that are fragile because they take shortcuts and overfit to the benchmark in various ways. We prescribe a principled framework for avoiding overfitting. Finally, there is a lack of standardization in evaluation practices, leading to a pervasive lack of reproducibility. We hope that the steps we introduce for addressing these shortcomings will spur the development of agents that are useful in the real world and not just accurate on benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑