发表机构
The Wharton School, University of Pennsylvania; Carnegie Mellon University; Harvard Business School, Harvard University（宾夕法尼亚大学沃顿商学院; 卡内基梅隆大学; 哈佛大学哈佛商学院）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
研究针对人工智能在白领分析性知识工作衡量上的差距，利用顶尖商学院案例教学法构建BusinessCaseBench基准，发现前沿AI模型在此基准上得分高且能力提升快，为商学院及相关职业角色带来启示。
AI 中文摘要
大语言模型在基准测试分数中迅速提升，但这些人工智能基准大多测试事实性回忆、狭义问答、数学问题解决、编码和代理工具使用等能力。对于白领专业人员日常进行的分析性知识工作，包括综合复杂信息、在不确定和不完整信息下做出判断、在多利益相关者环境中应用战略和对抗性思维、权衡取舍以及进行合理的结构化分析等方面的人工智能进展衡量不足。顶尖商学院采用的“案例教学法”为解决这一衡量差距提供了自然基础。我们构建了BusinessCaseBench基准，涵盖来自18个学科商业案例的数百个问题，并配有专家编写的教师案例解决方案得出的评分标准。前沿人工智能模型在BusinessCaseBench上已经能根据教师评分标准获得高分，且一个模型家族的能力在两年内有显著提升。这些结果表明人工智能在这类工作上的表现已经很高且正在迅速改善，对商学院和入门级专业角色有影响。
英文摘要
Large language models (LLMs) are improving rapidly as reflected in benchmark scores, yet these AI benchmarks largely test capabilities such as factual recall, narrow question answering, mathematical problem-solving, and coding and agentic tool-use. What remains poorly measured is AI progress on the analytical knowledge work white-collar professionals perform daily, including synthesizing complex information, exercising judgment under uncertainty and incomplete information, applying strategic and adversarial thinking in multi-stakeholder settings, weighing trade-offs, and producing defensible, structured analyses. This gap is even more pronounced for subjective components of such work, where success can be challenging to define. The "case method" form of education practiced by top business schools provides a natural foundation for addressing this measurement gap, and we construct BusinessCaseBench, a benchmark spanning hundreds of questions drawn from business cases across eighteen disciplines, each paired with a grading rubric derived from the expert-written instructor case solution. On BusinessCaseBench, frontier AI models already score highly against instructor rubrics, and capability within one model family improves substantially over two years. These results provide strong evidence that AI performance on this class of work is already high and rapidly improving, with implications for business schools, where case pedagogy trains undergraduates and MBAs in this kind of analytical reasoning, and for entry-level professional roles, where such skills have historically anchored early-career work.
