不要只说“我不知道”!自对齐大语言模型以带解释地回应未知问题
Don't Just Say "I don't know"! Self-aligning Large Language Models for Responding to Unknown Questions with Explanations
AI总结:
本文提出 Self-Align 自对齐框架,通过类别感知自增强与差异驱动自筛选生成并筛选未知问题回应数据,微调 LLM 使其在拒答时说明不可回答原因。
摘要:
尽管大语言模型(LLM)具备出色的问答能力,但即使问题没有确定答案,它们也往往表现出相当程度的过度自信。为避免对这些未知问题给出幻觉式答案,现有研究通常探索拒绝回答此类问题的方法。在本工作中,我们提出一种新颖且可扩展的自对齐方法,利用 LLM 自身增强其对不同类型未知问题的回应能力,不仅能够拒绝回答,还能够解释未知问题为何无法回答。具体而言,Self-Align 方法首先采用两阶段的类别感知自增强方法,生成大量未知问题—回应数据。随后,我们进行由差异驱动的自我筛选,以选择合格数据来微调 LLM 本身,从而按预期对齐其对未知问题的回应。在涵盖四种未知问题类型的两个数据集上,实验结果从三种任务表述形式验证了 Self-Align 方法相对于现有基线的优越性。
英文摘要:
Despite the remarkable abilities of Large Language Models (LLMs) to answer questions, they often display a considerable level of overconfidence even when the question does not have a definitive answer. To avoid providing hallucinated answers to these unknown questions, existing studies typically investigate approaches to refusing to answer these questions. In this work, we propose a novel and scalable self-alignment method to utilize the LLM itself to enhance its response-ability to different types of unknown questions, being capable of not only refusing to answer but also providing explanation to the unanswerability of unknown questions. Specifically, the Self-Align method first employ a two-stage class-aware self-augmentation approach to generate a large amount of unknown question-response data. Then we conduct disparity-driven self-curation to select qualified data for fine-tuning the LLM itself for aligning the responses to unknown questions as desired. Experimental results on two datasets across four types of unknown questions validate the superiority of the Self-Align method over existing baselines in terms of three types of task formulation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。