arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.14352cs.CL
收藏

LLM推理时自我改进综述

A Survey on LLM Inference-Time Self-Improvement

Texas A&M University(德克萨斯农工大学)

Xiangjue Dong, Maria Teleki, James Caverlee

AI总结:

本综述从独立、上下文感知和模型辅助三个视角全面回顾了LLM推理时自我改进技术,提出了深入分类体系并讨论了挑战与局限,为未来研究提供见解。

摘要:

通过在测试时增加计算量来增强推理的技术近期备受关注。在本综述中,我们从三个不同视角研究了LLM Inference-Time Self-Improvement的现状:Independent Self-improvement,侧重于通过解码或采样方法进行增强;Context-Aware Self-improvement,利用额外上下文或数据存储;以及Model-Aided Self-improvement,通过模型协作实现改进。我们对近期相关研究进行了全面回顾,提出了深入的分类体系,并讨论了挑战与局限,为未来研究提供了见解。

英文摘要:

Techniques that enhance inference through increased computation at test-time have recently gained attention. In this survey, we investigate the current state of LLM Inference-Time Self-Improvement from three different perspectives: Independent Self-improvement, focusing on enhancements via decoding or sampling methods; Context-Aware Self-Improvement, leveraging additional context or datastore; and Model-Aided Self-Improvement, achieving improvement through model collaboration. We provide a comprehensive review of recent relevant studies, contribute an in-depth taxonomy, and discuss challenges and limitations, offering insights for future research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑