从合理性视角重新审视大型语言模型的数据价值
Reframing Data Value for Large Language Models Through the Lens of Plausibility
AI总结:
针对大型语言模型训练数据价值评估成本高的问题,提出基于数据合理性的视角,认为模型自身能合理生成的数据价值较低,并据此推导出一种计算高效且具可证明性质的新型价值函数。
摘要:
数据价值评估旨在回答“这些数据价值几何?”这一重要问题。现有方法多聚焦于判别式模型,主要从训练效用的视角审视数据价值。然而,随着大型语言模型规模不断扩大,依赖需训练的评估方法变得日益昂贵且依赖特定技术。我们为语言模型的数据价值问题提出了一种替代视角,以数据的合理性为核心。我们假设,若数据能由模型自身合理生成,则其价值较低。从符合有价值数据直觉的若干标准出发,我们开发了一种计算上易于处理的新型价值函数,该函数基于第一性原理推导,具有可证明的性质。我们对价值函数进行了理论分析,并在多种场景和数据集上对其进行了评估。
英文摘要:
Data valuation seeks to answer the important question, "How much is this data worth?" Existing data valuation methods have largely focused on discriminative models, primarily examining data value through the lens of its utility in training. However, with the push for ever-larger language models, relying on valuation methods that require training becomes increasingly expensive and dependent on specific techniques. We propose an alternative perspective on the data value problem for language models, centering around the plausibility of the data. We posit that data holds lesser value if it can be plausibly generated by the model itself. Starting from some intuitive criteria that align with our notions of valuable data, we develop a novel value function that is computationally tractable and derived from first principles with provable properties. We conduct a theoretical analysis of our value function and evaluate it across multiple scenarios and datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。