arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.16552cs.CLcs.AI
收藏

SED:自我评估解码增强大型语言模型以提升生成质量

SED: Self-Evaluation Decoding Enhances Large Language Models for Better Generation

Fudan University(复旦大学);East China Normal University(华东师范大学)

Ziqin Luo, Haixia Han, Haokun Zhao, Guochao Jiang, Chengyu Du, Tingyun Li, Jiaqing Liang, Deqing Yang, Yanghua Xiao

AI总结:

针对LLM自回归解码在混沌点易选错令牌的问题,提出融合推测与评估的SED解码方法,实验验证其能优化令牌选择、提升生成质量。

摘要:

现有的大型语言模型(LLMs)通过单向自回归解码方法生成文本以回应用户的各种查询。这些方法往往以简单的顺序方式考虑令牌选择,在遇到不确定令牌时容易陷入次优选项,我们将其称为混沌点。LLMs生成的文本中存在许多混沌点,它们通常显著影响后续生成令牌的质量,从而干扰LLMs的生成。本文提出了自我评估解码(SED),一种用于增强模型生成的解码方法。类似于人类决策过程,SED将推测和评估步骤整合到解码过程中,使LLMs能够做出更谨慎的决策,从而在混沌点优化令牌选择。使用不同LLMs在各种任务上的实验结果表明了SED的有效性。

英文摘要:

Existing Large Language Models (LLMs) generate text through unidirectional autoregressive decoding methods to respond to various user queries. These methods tend to consider token selection in a simple sequential manner, making it easy to fall into suboptimal options when encountering uncertain tokens, referred to as chaotic points in our work. Many chaotic points exist in texts generated by LLMs, and they often significantly affect the quality of subsequently generated tokens, which can interfere with LLMs' generation. This paper proposes Self-Evaluation Decoding, SED, a decoding method for enhancing model generation. Analogous to the human decision-making process, SED integrates speculation and evaluation steps into the decoding process, allowing LLMs to make more careful decisions and thus optimize token selection at chaotic points. Experimental results across various tasks using different LLMs demonstrate SED's effectiveness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑