arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.18223cs.CL
收藏

通过自适应解码改进开放式文本生成

Improving Open-Ended Text Generation via Adaptive Decoding

Shanghai Jiao Tong University(上海交通大学)

Wenhong Zhu, Hongkun Hao, Zhiwei He, Yiming Ai, Rui Wang

AI总结:

本研究提出自适应解码机制,通过基于熵的置信度指标动态确定候选词元集,在平衡生成多样性与连贯性的同时提升了文本质量与模型推理能力。

摘要:

当前语言模型根据概率分布逐词元解码文本,确定下一个词元的合适候选词对确保生成质量至关重要。本研究引入了自适应解码,这是一种使语言模型在生成过程中动态确定合理候选集的机制。具体而言,我们引入了一种基于熵的指标称为置信度,并将确定最优候选集概念化为一个置信度增加的过程。通过利用置信度的增量来评估将某个词元纳入候选集的合理性。实验结果表明,我们的方法在多样性和连贯性之间取得了良好的平衡。人类评估显示,我们的方法能够生成人类偏好的文本。此外,我们的方法有潜力提升语言模型的推理能力。

英文摘要:

Current language models decode text token by token according to probabilistic distribution, and determining the appropriate candidates for the next token is crucial to ensure generation quality. This study introduces adaptive decoding, a mechanism that dynamically empowers language models to ascertain a sensible candidate set during generation. Specifically, we introduce an entropy-based metric called confidence and conceptualize determining the optimal candidate set as a confidence-increasing process. The rationality of including a token in the candidate set is assessed by leveraging the increment of confidence. Experimental results reveal that our method balances diversity and coherence well. The human evaluation shows that our method can generate human-preferred text. Additionally, our method can potentially improve the reasoning ability of language models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑