通过无标签课程有意义学习诊断与弥补大型语言模型中的知识缺陷
Diagnosing and Remedying Knowledge Deficiencies in LLMs via Label-free Curricular Meaningful Learning
AI总结:
提出无标签课程有意义学习框架LaMer,利用相对熵自动诊断LLMs知识缺陷,并通过自适应合成增强数据和课程策略逐步弥补缺陷,在多个基准上仅用40%数据即达基线水平。
摘要:
大型语言模型(LLMs)具有多功能性,通过挖掘和学习大量无标签文本中的信息,展现出令人印象深刻的泛化能力。然而,它们仍然表现出推理错误,通常源于知识缺陷,这可能影响其可信度和可靠性。尽管用户可以提供多样且全面的查询,但获得充分且有效的反馈要求很高。此外,在有限标签样本下全面评估LLMs也很困难。这使得通过丰富的无标签用户查询诊断和弥补LLMs的缺陷成为一项挑战。为应对这一挑战,我们提出了一种无标签课程有意义学习框架(LaMer)。LaMer首先采用相对熵在无标签设置下自动诊断和量化LLMs的知识缺陷。接下来,为了弥补已诊断的知识缺陷,我们应用课程有意义学习:首先,我们采用有意义学习根据缺陷的严重程度自适应地合成增强数据,然后设计课程缺陷弥补策略以逐步弥补LLMs的知识缺陷。实验表明,LaMer高效且有效地诊断和弥补了LLMs中的知识缺陷,在七个分布外(OOD)推理和语言理解基准上改进了各种LLMs,仅使用40%的训练数据就取得了与基线相当的结果。LaMer甚至超越了依赖标注数据集进行缺陷诊断的方法。在实际应用中,我们的无标签方法可为高效的LLM开发提供有效的知识缺陷诊断工具。
英文摘要:
Large Language Models (LLMs) are versatile and demonstrate impressive generalization ability by mining and learning information from extensive unlabeled text. However, they still exhibit reasoning mistakes, often stemming from knowledge deficiencies, which can affect their trustworthiness and reliability. Although users can provide diverse and comprehensive queries, obtaining sufficient and effective feedback is demanding. Furthermore, evaluating LLMs comprehensively with limited labeled samples is difficult. This makes it a challenge to diagnose and remedy the deficiencies of LLMs through rich label-free user queries. To tackle this challenge, we propose a label-free curricular meaningful learning framework (LaMer). LaMer first employs relative entropy to automatically diagnose and quantify the knowledge deficiencies of LLMs in a label-free setting. Next, to remedy the diagnosed knowledge deficiencies, we apply curricular meaningful learning: first, we adopt meaningful learning to adaptively synthesize augmentation data according to the severity of the deficiencies, and then design a curricular deficiency remedy strategy to remedy the knowledge deficiencies of LLMs progressively. Experiments show that LaMer efficiently and effectively diagnoses and remedies knowledge deficiencies in LLMs, improving various LLMs across seven out-of-distribution (OOD) reasoning and language understanding benchmarks, achieving comparable results to baselines with just 40\% training data. LaMer even surpasses methods that rely on labeled datasets for deficiency diagnosis. In application, our label-free method can offer an effective knowledge deficiency diagnostic tool for efficient LLM development.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。