arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.05093cs.CLcs.AI
收藏

幻觉中的顺序至关重要:推理顺序作为大语言模型的基准与反身提示

Order Matters in Hallucination: Reasoning Order as Benchmark and Reflexive Prompting for Large-Language-Models

University of Science and Technology of China(中国科学技术大学)

Zikai Xie

AI总结:

针对LLM推理与答案生成顺序导致的不一致及数值幻觉,本文提出双顺序一致性基准和一种简单反身提示策略,实验显示其可提升多种模型的可靠性。

摘要:

大语言模型(LLM)自问世以来便引起了广泛关注,并在各类学术和工业领域得到应用。然而,这些模型常受到“幻觉问题”的困扰:其输出虽然在语法和逻辑上连贯,却缺乏事实准确性,甚至完全是编造的。近期发现并被广泛讨论的一个尤其令人不安的问题是数值比较错误,即多个LLM错误地推断“9.11>9.9”。我们发现,LLM生成答案和推理的顺序会影响其一致性。具体而言,当LLM先生成答案再给出推理,与先生成推理过程再得出结论相比,结果会显著不同。受此启发,我们提出了一种评估LLM一致性的新基准方法:比较通过这两种不同方式生成的回答。该基准能够有效识别LLM先编造答案、随后生成辩解的情形。此外,我们引入了一种新颖而简单的提示策略,旨在缓解这一问题。实验结果表明,与直接提问相比,该策略提升了多种LLM的性能。本工作不仅揭示了LLM中的一个关键缺陷,也提供了一种增强其可靠性的实用解决方案。

英文摘要:

Large language models (LLMs) have generated significant attention since their inception, finding applications across various academic and industrial domains. However, these models often suffer from the "hallucination problem", where outputs, though grammatically and logically coherent, lack factual accuracy or are entirely fabricated. A particularly troubling issue discovered and widely discussed recently is the numerical comparison error where multiple LLMs incorrectly infer that "9.11$>$9.9". We discovered that the order in which LLMs generate answers and reasoning impacts their consistency. Specifically, results vary significantly when an LLM generates an answer first and then provides the reasoning versus generating the reasoning process first and then the conclusion. Inspired by this, we propose a new benchmark method for assessing LLM consistency: comparing responses generated through these two different approaches. This benchmark effectively identifies instances where LLMs fabricate answers and subsequently generate justifications. Furthermore, we introduce a novel and straightforward prompt strategy designed to mitigate this issue. Experimental results demonstrate that this strategy improves performance across various LLMs compared to direct questioning. This work not only sheds light on a critical flaw in LLMs but also offers a practical solution to enhance their reliability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑