arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.03387cs.CLcs.AI
收藏

LIMO: 推理中少即是多

LIMO: Less is More for Reasoning

Shanghai Jiao Tong University(上海交通大学);SII-GAIR;Fudan University(复旦大学);The Hong Kong Polytechnic University(香港理工大学)

Yixin Ye, Zhen Huang, Yang Xiao, Ethan Chern, Shijie Xia, Pengfei Liu

AI总结:

该研究提出LIMO模型与LIMO假设,证明预训练完备的大语言模型仅需极少策略性设计的示例,通过简单监督微调即可获得强推理与分布外泛化能力,打破了复杂推理需海量训练数据的固有认知。

摘要:

我们对大语言模型(LLM)的复杂推理必须依赖海量训练数据这一普遍假设提出挑战。我们证明,仅需少量示例即可催生复杂的数学推理能力。具体而言,通过简单的监督微调,我们的模型LIMO在AIME24数据集上达到63.3%的准确率,在MATH500数据集上达到95.6%的准确率,超越了此前的微调模型(AIME24上6.5%,MATH500上59.2%),而训练数据用量仅为先前方法所需的1%。此外,LIMO展现出强劲的分布外泛化能力,在各类基准测试上取得了45.8%的绝对提升,优于使用100倍以上数据训练的模型。综合这些发现,我们提出“少即是多推理假设”(Less-Is-More Reasoning Hypothesis,简称LIMO假设):在预训练阶段已全面编码领域知识的基础模型中,复杂推理可通过极少但经过策略性设计的认知过程示例催生。该假设表明,激发复杂推理的阈值并非由任务复杂度决定,而是取决于两个关键因素:(1)模型预训练知识库的完备性;(2)后训练示例作为引导推理的“认知模板”的有效性。

英文摘要:

We challenge the prevailing assumption that complex reasoning in large language models (LLMs) necessitates massive training data. We demonstrate that sophisticated mathematical reasoning can emerge with only a few examples. Specifically, through simple supervised fine-tuning, our model, LIMO, achieves 63.3\% accuracy on AIME24 and 95.6\% on MATH500, surpassing previous fine-tuned models (6.5\% on AIME24, 59.2\% on MATH500) while using only 1\% of the training data required by prior approaches. Furthermore, LIMO exhibits strong out-of-distribution generalization, achieving a 45.8\% absolute improvement across diverse benchmarks, outperforming models trained on 100x more data. Synthesizing these findings, we propose the Less-Is-More Reasoning Hypothesis (LIMO Hypothesis): In foundation models where domain knowledge has been comprehensively encoded during pre-training, sophisticated reasoning can emerge through minimal but strategically designed demonstrations of cognitive processes. This hypothesis suggests that the threshold for eliciting complex reasoning is not dictated by task complexity but rather by two key factors: (1) the completeness of the model's pre-trained knowledge base and (2) the effectiveness of post-training examples in serving as "cognitive templates" that guide reasoning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑