arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.14765cs.LGcs.AIcs.CL
收藏

我的数据中有什么新内容?通过对比生成进行新颖性探索

What's New in My Data? Novelty Exploration via Contrastive Generation

University of Edinburgh(爱丁堡大学);University of Tokyo(东京大学);University of Amsterdam(阿姆斯特丹大学)

Masaru Isonuma, Ivan Titov

AI总结:

本文提出对比生成式探索(CGE)方法,通过对比预训练模型与微调模型的预测来生成示例,从而在不直接访问数据的情况下发现微调数据集中的新颖属性,并引入迭代机制提升生成多样性。

摘要:

微调被广泛用于使语言模型适应特定目标,通常利用现实世界的数据,例如患者记录、客户服务交互或预训练中未覆盖语言的网络内容。这些数据集通常规模庞大、充满噪声,并且往往是保密的,这使得直接检查它们变得困难。然而,理解这些数据对于指导模型部署以及就数据清理或抑制微调过程中学到的任何有害行为做出决策至关重要。在本研究中,我们引入了通过生成进行新颖性发现的任务,该任务旨在通过生成能够说明这些属性的示例来识别微调数据集的新颖属性。我们的方法,对比生成式探索(Contrastive Generative Exploration,CGE),假设无法直接访问数据,而是依赖一个预训练模型和微调后的同一模型。通过对比这两个模型的预测,CGE可以生成突出微调数据新颖特征的示例。然而,这种简单的方法可能会产生彼此过于相似的示例,无法捕捉数据集中存在的全部新颖现象。我们通过引入CGE的迭代版本来解决这个问题,在该版本中,先前生成的示例被用于更新预训练模型,然后将这个更新后的模型与完全微调的模型进行对比,以生成下一个示例,从而促进生成输出的多样性。我们的实验证明了CGE在检测新颖内容(如有毒语言)以及新的自然语言和编程语言方面的有效性。此外,我们表明,即使模型使用差分隐私技术进行微调,CGE仍然有效。

英文摘要:

Fine-tuning is widely used to adapt language models for specific goals, often leveraging real-world data such as patient records, customer-service interactions, or web content in languages not covered in pre-training. These datasets are typically massive, noisy, and often confidential, making their direct inspection challenging. However, understanding them is essential for guiding model deployment and informing decisions about data cleaning or suppressing any harmful behaviors learned during fine-tuning. In this study, we introduce the task of novelty discovery through generation, which aims to identify novel properties of a fine-tuning dataset by generating examples that illustrate these properties. Our approach, Contrastive Generative Exploration (CGE), assumes no direct access to the data but instead relies on a pre-trained model and the same model after fine-tuning. By contrasting the predictions of these two models, CGE can generate examples that highlight novel characteristics of the fine-tuning data. However, this simple approach may produce examples that are too similar to one another, failing to capture the full range of novel phenomena present in the dataset. We address this by introducing an iterative version of CGE, where the previously generated examples are used to update the pre-trained model, and this updated model is then contrasted with the fully fine-tuned model to generate the next example, promoting diversity in the generated outputs. Our experiments demonstrate the effectiveness of CGE in detecting novel content, such as toxic language, as well as new natural and programming languages. Furthermore, we show that CGE remains effective even when models are fine-tuned using differential privacy techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑