arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2311.01964cs.CLcs.AI
收藏

别让你的大语言模型成为评估基准作弊者

Don't Make Your LLM an Evaluation Benchmark Cheater

Renmin University of China(中国人民大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Kun Zhou, Yutao Zhu, Zhipeng Chen, Wentong Chen, Wayne Xin Zhao, Xu Chen, Yankai Lin, Ji-Rong Wen, Jiawei Han

AI总结:

本文针对大语言模型评估中的基准泄露问题,通过实验验证其会大幅虚高评估结果、导致性能评估不可靠,并为开发者和基准维护者提出了合理使用评估基准的相关准则。

摘要:

大语言模型(LLMs)极大推动了人工智能的前沿发展,在模型能力上取得了显著提升。为评估模型性能,常用方法是构建评估基准,用以衡量LLMs在不同方面的能力水平。尽管已有多个高质量基准发布,但人们对这些基准的合理使用、以及不同模型间公平比较的担忧日益加剧。针对这些担忧,本文探讨了不当使用评估基准、以及对评估结果进行误导性解读的潜在风险与影响。我们特别聚焦于一种会导致评估不当的特殊问题,即“基准泄露(benchmark leakage)”,指的是与测试集相关的数据偶尔被用于模型训练的情况。由于预训练数据通常在模型测试前就已准备好,这种现象如今愈发普遍。我们开展了大量实验研究基准泄露的影响,发现它能大幅提升评估结果,最终会导致模型性能评估不可靠。为改进现有评估基准的使用方式,我们最后为LLM开发者和基准维护者提出了若干准则。我们希望这项工作能引起人们对LLMs合理训练与评估的重视。

英文摘要:

Large language models~(LLMs) have greatly advanced the frontiers of artificial intelligence, attaining remarkable improvement in model capacity. To assess the model performance, a typical approach is to construct evaluation benchmarks for measuring the ability level of LLMs in different aspects. Despite that a number of high-quality benchmarks have been released, the concerns about the appropriate use of these benchmarks and the fair comparison of different models are increasingly growing. Considering these concerns, in this paper, we discuss the potential risk and impact of inappropriately using evaluation benchmarks and misleadingly interpreting the evaluation results. Specially, we focus on a special issue that would lead to inappropriate evaluation, \ie \emph{benchmark leakage}, referring that the data related to evaluation sets is occasionally used for model training. This phenomenon now becomes more common since pre-training data is often prepared ahead of model test. We conduct extensive experiments to study the effect of benchmark leverage, and find that it can dramatically boost the evaluation results, which would finally lead to an unreliable assessment of model performance. To improve the use of existing evaluation benchmarks, we finally present several guidelines for both LLM developers and benchmark maintainers. We hope this work can draw attention to appropriate training and evaluation of LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑