arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.16341cs.LGcs.CLcs.SE
收藏

质量至关重要:评估用于工具的LLM的合成数据

Quality Matters: Evaluating Synthetic Data for Tool-Using LLMs

Amazon(亚马逊);Technion - Israel Institute of Technology(以色列理工学院);Technology Innovation Institute(技术创新研究院);OriginAI

Shadi Iskander, Nachshon Cohen, Zohar Karnin, Ori Shapira, Sofia Tolmach

AI总结:

提出两种评估方法(人类定义标准和模型驱动评估)来检验工具使用LLM的合成数据质量,实验证明高质量小数据训练优于未验证大数据,强调了数据可靠性评估的重要性。

摘要:

训练大型语言模型(LLM)以使用外部工具是一个快速扩展的领域,最近的研究集中在生成合成数据以解决可用数据短缺的问题。然而,缺乏系统的数据质量检查给模型的正确训练和测试带来了复杂性。为此,我们提出了两种方法来评估用于训练LLM使用外部工具的数据的可靠性。第一种方法使用直观的、人类定义的正确性标准。第二种方法使用基于模型的评估,结合上下文进行评估。我们在两个流行的基准上进行了彻底的数据质量评估,随后进行了外部评估,展示了数据质量对模型性能的影响。我们的结果表明,在高质量数据上训练的模型优于在未经验证数据上训练的模型,即使训练数据量较少也是如此。这些发现从经验上支持了评估和确保工具使用LLM训练数据可靠性的重要性。

英文摘要:

Training large language models (LLMs) for external tool usage is a rapidly expanding field, with recent research focusing on generating synthetic data to address the shortage of available data. However, the absence of systematic data quality checks poses complications for properly training and testing models. To that end, we propose two approaches for assessing the reliability of data for training LLMs to use external tools. The first approach uses intuitive, human-defined correctness criteria. The second approach uses a model-driven assessment with in-context evaluation. We conduct a thorough evaluation of data quality on two popular benchmarks, followed by an extrinsic evaluation that showcases the impact of data quality on model performance. Our results demonstrate that models trained on high-quality data outperform those trained on unvalidated data, even when trained with a smaller quantity of data. These findings empirically support the significance of assessing and ensuring the reliability of training data for tool-using LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑