EvalTree:通过分层能力树剖析语言模型的弱点
EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees
AI总结:
本文提出EvalTree方法,通过构建分层能力树来剖析语言模型弱点,更精确全面地识别模型失败点并指导数据收集以提升性能。
摘要:
理想的模型评估应实现两个目标:识别模型在何处失败以及提供可操作的改进指导。为了实现语言模型(LM)评估的这些目标,我们提出了一个问题:给定LM在基准测试中每个单独实例上的表现,生成一个弱点剖析,即一组用自然语言表达的弱点。我们引入了一套定量评估方法来比较不同的弱点剖析方法。我们还引入了一种弱点剖析方法EvalTree。EvalTree构建了一棵能力树,其中每个节点代表一种用自然语言描述的能力,并链接到专门评估该能力的基准实例子集;然后它提取LM表现不佳的节点来生成弱点剖析。在MATH和WildChat基准上,我们展示了EvalTree通过更精确和全面地识别弱点,优于基线弱点剖析方法。弱点剖析进一步支持了弱点引导的数据收集,而由EvalTree识别出的弱点引导的训练数据收集比其他数据收集策略更能提升LM性能。我们还展示了EvalTree如何暴露Chatbot Arena基于人类投票者评估实践中的缺陷。为了促进未来的工作,我们提供了一个界面,允许从业者交互式地探索EvalTree构建的能力树。
英文摘要:
An ideal model evaluation should achieve two goals: identifying where the model fails and providing actionable improvement guidance. Toward these goals for language model (LM) evaluations, we formulate the problem of generating a weakness profile, a set of weaknesses expressed in natural language, given an LM's performance on every individual instance in a benchmark. We introduce a suite of quantitative assessments to compare different weakness profiling methods. We also introduce a weakness profiling method EvalTree. EvalTree constructs a capability tree where each node represents a capability described in natural language and is linked to a subset of benchmark instances that specifically evaluate this capability; it then extracts nodes where the LM performs poorly to generate a weakness profile. On the MATH and WildChat benchmarks, we show that EvalTree outperforms baseline weakness profiling methods by identifying weaknesses more precisely and comprehensively. Weakness profiling further enables weakness-guided data collection, and training data collection guided by EvalTree-identified weaknesses improves LM performance more than other data collection strategies. We also show how EvalTree exposes flaws in Chatbot Arena's human-voter-based evaluation practice. To facilitate future work, we provide an interface that allows practitioners to interactively explore the capability trees built by EvalTree.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。