大模型推理能力

Tokenization Constraints in LLMs: A Study of Symbolic and Arithmetic Reasoning Limits

Xiang Zhang, Juntai Cao, Jiaqi Wei, Yiwei Xu, Chenyu You

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

S-GRPO: Early Exit via Reinforcement Learning in Reasoning Models

Muzhi Dai, Chenxu Yang, Qingyi Si

机构 * Huawei Technologies Co., Ltd.（华为技术有限公司） ； Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.AI、cs.LG

Reasoning Models Know When They're Right: Probing Hidden States for Self-Verification

Anqi Zhang, Yulin Chen, Jane Pan, Chen Zhao, Aurojit Panda, Jinyang Li, He He

机构 * New York University（纽约大学） ； NYU Shanghai（上海纽约大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；logical reasoning(abstract)；verifier(abstract)；分类 cs.CL、cs.AI

Cross-Lingual Consistency: A Novel Inference Framework for Advancing Reasoning in Large Language Models

Zhiwei Yu, Tuo Li, Changhong Wang, Hui Chen, Lang Zhou

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning

Md Rifat Arefin, Gopeshh Subbaraj, Nicolas Gontier, Yann LeCun, Irina Rish, Ravid Shwartz-Ziv, Christopher Pal

机构 * Université de Montréal（蒙特利尔大学） ； Mila（米拉研究所） ； ServiceNow（ServiceNow公司） ； Polytechnique Montreal（蒙特利尔理工学院） ； Meta FAIR ； New York University（纽约大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.LG

MetaLadder: Ascending Mathematical Solution Quality via Analogical-Problem Reasoning Transfer

Honglin Lin, Zhuoshi Pan, Yu Li, Qizhi Pei, Xin Gao, Mengzhang Cai, Conghui He, Lijun Wu

机构 * Shanghai AI Laboratory（上海人工智能实验室） ； Tsinghua University（清华大学） ； Renmin University of China（中国人民大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Effectiveness of Zero-shot-CoT in Japanese Prompts

Shusuke Takayama, Ian Frank

机构 * Future University Hakodate（函馆未来大学） 纠错

专题命中 数学推理 ：CoT(title,abstract)；reasoning(abstract)；chain-of-thought(abstract)；分类 cs.CL、cs.AI

Comments NLP2025 Workshop on Japanese Language Resources (JLR2025)

Weaker LLMs' Opinions Also Matter: Mixture of Opinions Enhances LLM's Mathematical Reasoning

Yanan Chen, Ali Pesaranghader, Tanmana Sadhu

机构 * LG Electronics（LG电子） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments 12 pages, 1 figure, 3 tables, 4 prompt/data templates

Self-rewarding correction for mathematical reasoning

Wei Xiong, Hanning Zhang, Chenlu Ye, Lichang Chen, Nan Jiang, Tong Zhang

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； University of Maryland, College Park（马里兰大学帕克分校） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；self-correction(abstract)；分类 cs.AI、cs.LG

Table as Thought: Exploring Structured Thoughts in LLM Reasoning

Zhenjie Sun, Naihao Deng, Haofei Yu, Jiaxuan You

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；planning(abstract)；分类 cs.CL、cs.AI

Multilingual Mathematical Reasoning: Advancing Open-Source LLMs in Hindi and English

Avinash Anand, Kritarth Prasad, Chhavi Kirtani, Ashwin R Nair, Manvendra Kumar Nema, Raj Jaiswal, Rajiv Ratn Shah

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Accepted at AAAI 2025

Critical-Questions-of-Thought: Steering LLM reasoning with Argumentative Querying

Federico Castagna, Isabel Sassoon, Simon Parsons

机构 * University of Lincoln（林肯大学） ； Brunel University of London（伦敦布鲁内尔大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness

Yu Kang, Xianghui Sun, Liangyu Chen, Wei Zou

专题命中 数学推理 ：chain-of-thought(title,abstract)；reasoning(abstract)；CoT(abstract)；分类 cs.CL、cs.LG

Comments Accepted by AAAI 2025

Improve Mathematical Reasoning in Language Models by Automated Process Supervision

Liangchen Luo, Yinxiao Liu, Rosanne Liu, Samrat Phatale, Meiqi Guo, Harsh Lara, Yunxuan Li, Lei Shu, Yun Zhu, Lei Meng, Jiao Sun, Abhinav Rastogi

机构 * Google DeepMind（谷歌DeepMind） ； Google（谷歌公司） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract)；math reasoning(abstract)；分类 cs.CL、cs.LG

Comments 17 pages, 5 figures, 2 table

Key-Point-Driven Mathematical Reasoning Distillation of Large Language Model

Xunyu Zhu, Jian Li, Can Ma, Weiping Wang

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Major Updates:1.fix faults in the error analysis, 2. improve our method, 3. use ChatGPT as teacher LLMs to ensure fairness in performance comparisons

Improving LLM Reasoning through Scaling Inference Computation with Collaborative Verification

Zhenwen Liang, Ye Liu, Tong Niu, Xiangliang Zhang, Yingbo Zhou, Semih Yavuz

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.AI、cs.LG

Progressive-Hint Prompting Improves Reasoning in Large Language Models

Chuanyang Zheng, Zhengying Liu, Enze Xie, Zhenguo Li, Yu Li

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.LG

Comments Accepted to ICML AI4MATH 2024

SAAS: Solving Ability Amplification Strategy for Enhanced Mathematical Reasoning in Large Language Models

Hyeonwoo Kim, Gyoungjin Gim, Yungi Kim, Jihoo Kim, Byungju Kim, Wonseok Lee, Chanjun Park

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP 2024 Industry Track

Towards a Generative Approach for Emotion Detection and Reasoning

Ankita Bhaumik, Tomek Strzalkowski

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Distilling Mathematical Reasoning Capabilities into Small Language Models

Xunyu Zhu, Jian Li, Yong Liu, Can Ma, Weiping Wang

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Accepted for publication in Neural Networks

ThoughtSource: A central hub for large language model reasoning data

Simon Ott, Konstantin Hebenstreit, Valentin Liévin, Christoffer Egeberg Hother, Milad Moradi, Maximilian Mayrhauser, Robert Praas, Ole Winther, Matthias Samwald

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Revision: added datasets, formatting

Journal ref Scientific Data 10, 528 (2023)

Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning

Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract)；math reasoning(abstract)；分类 cs.CL、cs.AI

DialCoT Meets PPO: Decomposing and Exploring Reasoning Paths in Smaller Language Models

Chengcheng Han, Xiaowei Du, Che Zhang, Yixin Lian, Xiang Li, Ming Gao, Baoyuan Wang

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP 2023

LPML: LLM-Prompting Markup Language for Mathematical Reasoning

Ryutaro Yamauchi, Sho Sonoda, Akiyoshi Sannai, Wataru Kumagai

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.AI、cs.LG

MathPrompter: Mathematical Reasoning using Large Language Models

Shima Imani, Liang Du, Harsh Shrivastava

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

K2-Think: A Parameter-Efficient Reasoning System

Zhoujun Cheng, Richard Fan, Shibo Hao, Taylor W. Killian, Haonan Li, Suqi Sun, Hector Ren, Alexander Moreno, Daqian Zhang, Tianjun Zhong, Yuxin Xiong, Yuanzhe Hu, Yutao Xie, Xudong Han, Yuqi Wang, Varad Pimpalkhute, Yonghao Zhuang, Aaryamonvikram Singh, Xuezhi Liang, Anze Xie, Jianshu She, Desai Fan, Chengqian Gao, Liqun Ma, Mikhail Yurochkin, John Maggs, Xuezhe Ma, Guowei He, Zhiting Hu, Zhengzhong Liu, Eric P. Xing

机构 * Institute of Foundation Models, Mohamed bin Zayed University of Artificial Intelligence（基础模型研究所，穆罕默德·本·扎耶德人工智能大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；planning(abstract)；分类 cs.LG

Comments To access the K2-Think reasoning system, please visit www.k2think.ai

Epistemic Gain, Aleatoric Cost: Uncertainty Decomposition in Multi-Agent Debate for Math Reasoning

认知增益，偶然成本：多智能体辩论中的不确定性分解用于数学推理

Dan Qiao, Binbin Chen, Fengyu Cai, Jianlong Chen, Wenhao Li, Fuxin Jiang, Zuzhi Chen, Hongyuan Zha, Tieying Zhang, Baoxiang Wang

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(title)

AI总结 本文提出贝叶斯不确定性分析框架，将多智能体辩论中的预测不确定性分解为认知不确定性和偶然不确定性，并设计不确定性引导的多智能体强化学习算法，在控制偶然成本的同时提升认知增益，从而提高推理准确性和辩论效率。

Comments ICML2026

Variation in Verification: Understanding Verification Dynamics in Large Language Models

验证的多样性：理解大型语言模型中的验证动态

Yefan Zhou, Austin Xu, Yilun Zhou, Janvijay Singh, Jiang Gui, Shafiq Joty

机构 * Salesforce AI Research（Salesforce AI研究院） ； Dartmouth College（达特茅斯学院） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） 纠错

专题命中 数学推理 ：CoT(abstract,abstract_cn)；reasoning(abstract)；chain-of-thought(abstract)；verifier(abstract)

AI总结 研究大型语言模型中验证动态，分析问题难度、生成器能力及验证器生成能力三个维度，发现验证有效性与问题难度相关，优化TTS应用中的基本验证策略。

Comments ICLR 2026

When Shallow Wins: Silent Failures and the Depth-Accuracy Paradox in Latent Reasoning

浅层胜出：潜在推理中的沉默失败与深度-准确性悖论

Subramanyam Sahoo, Aman Chadha, Vinija Jain, Divya Chaudhary

机构 * Independent（独立研究者） ； AWS Generative AI Innovation Center, Amazon Web Services（亚马逊生成AI创新中心，亚马逊网络服务） ； Meta AI ； Stanford University（斯坦福大学） ； Northeastern University, Seattle, WA, USA（东北ern大学，西雅图，华盛顿州，美国） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract,comments)；分类 cs.CL、cs.AI、cs.LG

AI总结 研究揭示数学推理模型在深度增加时准确率无提升，且存在大量不可靠推理路径，需改革评估方法以衡量稳定性。

Comments Accepted at ICLR 2026 Workshop on Latent & Implicit Thinking - Going Beyond CoT Reasoning. 19 Pages and 5 Figures

MathReal: We Keep It Real! A Real Scene Benchmark for Evaluating Math Reasoning in Multimodal Large Language Models

Jun Feng, Zixin Wang, Zhentao Zhang, Yue Guo, Zhihan Zhou, Xiuyi Chen, Zhenyang Li, Dawei Yin

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(title)

Comments 29 pages, 16 figures