零到强泛化:无金标迭代激发大型语言模型的强大能力
Zero-to-Strong Generalization: Eliciting Strong Capabilities of Large Language Models Iteratively without Gold Labels
AI总结:
本研究提出“零到强泛化”范式,通过迭代提示LLMs标注未标注数据并过滤高质量标签,无需金标即可逐步激发模型在下游分类与推理任务上的强大能力,实验验证其有效性并适用于多种模型规模。
摘要:
大型语言模型(LLMs)通过监督微调或基于金标的上下文学习已展现出卓越性能。然而,这一范式受限于金标的可用性,在某些场景下,LLMs可能需要执行对人类而言过于复杂而无法提供此类标签的任务。为应对这一挑战,本研究探讨是否仅利用未标注数据即可激发模型的强大能力。我们提出一种名为“零到强泛化”的新范式。我们迭代地提示LLMs对未标注数据进行标注,并通过过滤保留高质量标签。令人惊讶的是,我们观察到这一迭代过程逐步解锁了LLMs在下游任务上的潜力。我们在广泛的分类和推理任务上的实验证实了我们所提出框架的有效性。我们的分析表明,该范式对上下文学习和微调均有效,且适用于各种模型规模。
英文摘要:
Large Language Models (LLMs) have demonstrated remarkable performance through supervised fine-tuning or in-context learning using gold labels. However, this paradigm is limited by the availability of gold labels, while in certain scenarios, LLMs may need to perform tasks that are too complex for humans to provide such labels. To tackle this challenge, this study explores whether solely utilizing unlabeled data can elicit strong model capabilities. We propose a new paradigm termed zero-to-strong generalization. We iteratively prompt LLMs to annotate unlabeled data and retain high-quality labels by filtering. Surprisingly, we obverse that this iterative process gradually unlocks LLMs' potential on downstream tasks. Our experiments on extensive classification and reasoning tasks confirm the effectiveness of our proposed framework. Our analysis indicates that this paradigm is effective for both in-context learning and fine-tuning, and for various model sizes.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。