arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.07030cs.CVcs.CL
收藏

受污染视觉语言模型的洁净评估

Clean Evaluations on Contaminated Visual Language Models

The Chinese University of Hong Kong(香港中文大学);National University of Singapore(新加坡国立大学)

Hongyuan Lu, Shujie Miao, Wai Lam

AI总结:

针对视觉语言模型洁净评估研究不足的问题,本研究提出基于视觉输入数据增强的评估方法,构建了含数千实例的新基准,发现BGR通道切换增强可有效降低数据污染影响且难以被恶意用于训练,为视觉大语言模型的洁净评估提供了可行方案。

摘要:

如何对大语言模型(LLMs)进行洁净评估已成为重要研究方向,旨在真实报告可能受污染的大语言模型的性能。然而,如何对视觉语言模型(VLMs)开展洁净评估仍是一个研究不足的问题。我们提出了一种通过对视觉输入信息采用数据增强方法来实现该目标的新途径,随后构建了一个包含数千个数据实例的新型视觉洁净评估基准。通过大量实验,我们发现传统的视觉数据增强方法虽然有用,但存在被当作训练数据的一部分以规避检测的风险。我们进一步提出使用BGR增强来切换视觉信息的颜色通道。研究发现,这是一种简单且有效的降低数据污染影响的方法,而且值得注意的是,它若被用作训练阶段的数据增强方法反而会产生负面影响。这意味着恶意训练者很难将此类数据增强方法整合到训练过程中,因此它有望成为一种用于洁净评估视觉大语言模型的技术。我们的代码、数据和模型权重将在论文发表后公开。

英文摘要:

How to evaluate large language models (LLMs) cleanly has been established as an important research era to genuinely report the performance of possibly contaminated LLMs. Yet, how to cleanly evaluate the visual language models (VLMs) is an under-studied problem. We propose a novel approach to achieve such goals through data augmentation methods on the visual input information. We then craft a new visual clean evaluation benchmark with thousands of data instances. Through extensive experiments, we found that the traditional visual data augmentation methods are useful, but they are at risk of being used as a part of the training data as a workaround. We further propose using BGR augmentation to switch the colour channel of the visual information. We found that it is a simple yet effective method for reducing the effect of data contamination and fortunately, it is also harmful to be used as a data augmentation method during training. It means that it is hard to integrate such data augmentation into training by malicious trainers and it could be a promising technique to cleanly evaluate visual LLMs. Our code, data, and model weights will be released upon publication.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑